00000001:02000400:1.0F:1788845233.317957:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788845241.653131:0:3161:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788845242.512923:0:3204:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1299 MB/s 00000001:01000000:2.0:1788845242.762688:0:3204:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1631 MB/s 00000001:01000000:2.0:1788845243.012446:0:3204:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10271 MB/s 00000020:02000000:3.0F:1788845243.309544:0:3252:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_108_g4a8ba26 00000400:02000000:0.0:1788845243.679287:0:3267:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.135@tcp [8/256/0/180] 00008000:02000000:3.0:1788845246.123432:0:3417:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788845288.639661:0:5220:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788845298.363285:0:5798:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788845298.363291:0:5798:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788845298.363899:0:5798:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000001d8c3e5 00000080:02000400:0.0:1788845298.363913:0:5798:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788845298.377987:0:5798:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788845298.378000:0:5798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788845298.378042:0:5798:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002fbaf018) 00000020:00000080:1.0:1788845298.378246:0:5798:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788845298.434395:0:5798:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788845298.437932:0:5798:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788845298.475235:0:5798:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788845298.475502:0:5798:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788845298.475600:0:5798:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788845298.475656:0:5798:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788845298.475684:0:5798:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788845298.476187:0:5798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788845298.476197:0:5798:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788845298.476211:0:5798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6df942b 00000020:01000004:2.0:1788845298.476220:0:5798:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788845298.476227:0:5798:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788845298.476232:0:5798:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000001d8c3e5 from MGS 00000020:01000004:2.0:1788845298.476589:0:5798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788845298.476614:0:5798:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000474ede5b) 00000020:00000080:2.0:1788845298.476627:0:5798:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788845298.476837:0:5798:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000001d8c3e5 from MGS, refs=2 00080000:01000000:2.0:1788845298.476844:0:5798:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788845298.476851:0:5798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6df9439 00000100:00100000:2.0:1788845298.476964:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788845298.477117:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788845298.477124:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788845298.478123:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788845298.478132:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788845298.479159:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845298.479640:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788845298.479648:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788845298.481039:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788845298.481054:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788845298.481994:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788845298.482004:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788845298.482981:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845298.482985:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845298.482987:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845298.483253:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845298.483255:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845298.483257:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845298.484301:0:5798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788845298.485494:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788845298.733898:0:5798:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4835 MB/s 00000001:01000000:1.0:1788845298.983539:0:5798:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4783 MB/s 00000001:01000000:3.0:1788845299.233707:0:5798:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 879 MB/s 00000001:01000000:2.0:1788845299.484019:0:5798:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1403 MB/s 00080000:10000000:2.0:1788845299.491310:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788845299.503629:0:5798:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788845299.503650:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788845299.503653:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788845299.511168:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788845299.512309:0:5798:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788845299.512463:0:5798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788845299.512839:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788845299.512869:0:5798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788845299.519242:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845299.519496:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788845299.519502:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788845299.523153:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788845299.523171:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788845299.523654:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788845299.523662:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788845299.526303:0:5813:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788845299.526404:0:5798:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788845299.526430:0:5798:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.135@tcp' 00000020:01000004:2.0:1788845299.526432:0:5798:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788845299.526527:0:5798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.135@tcp (typ=mgc) 00000020:00000080:2.0:1788845299.526541:0:5798:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.135@tcp (00000000999745a2) 00000020:00000080:2.0:1788845299.526562:0:5798:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788845299.526807:0:5798:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ffb3146a@MGC192.168.206.135@tcp: add connection 192.168.206.135@tcp at head 00010000:00010000:2.0:1788845299.527008:0:5798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.135@tcp-0 is initialized 00000040:01000000:2.0:1788845299.527015:0:5798:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788845299.527984:0:5814:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788845299.528065:0:5798:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.135@tcp (uuid e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6) 00000020:00000080:0.0:1788845299.528215:0:5798:0:(genops.c:1385:class_connect()) connect: client e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6, cookie 0xd8041b54d6df9447 00000100:00080000:0.0:1788845299.528228:0:5798:0:(import.c:510:import_select_connection()) MGC192.168.206.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788845299.528233:0:5798:0:(import.c:624:import_select_connection()) MGC192.168.206.135@tcp: import 00000000ffb3146a using connection 192.168.206.135@tcp/0@lo 00000100:00100000:0.0:1788845299.528281:0:5798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002406ff9a x1875740189524096/t0(0) o250->MGC192.168.206.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788845299.528316:0:5798:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6->MGS 00000020:01000004:0.0:1788845299.528340:0:5798:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788845299.528346:0:5798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788845299.528358:0:5798:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005b43ad27) 00000020:00000080:0.0:1788845299.528386:0:5798:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788845299.528411:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002406ff9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3282:1875740189524096:0@lo:250: 00000100:00100000:2.0:1788845299.528504:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845299.541412:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189524096 00000100:00100000:2.0:1788845299.541433:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189524096 00000100:00100000:2.0:1788845299.541483:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845299.541492:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008346f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1875740189524096:12345-0@lo:250: 00010000:00080000:2.0:1788845299.541800:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6@0@lo t0 exp 0000000000000000 cur 108 last 0 00000020:00000080:2.0:1788845299.541838:0:5810:0:(genops.c:1385:class_connect()) connect: client e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6, cookie 0xd8041b54d6df9455 00000100:00080000:2.0:1788845299.542015:0:5810:0:(import.c:65:import_set_state_nolock()) 00000000fc4d0b04 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845299.542113:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008346f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:3282:x1875740189524096:12345-0@lo:250: Request processed in 621us (13609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845299.542122:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845299.542187:0:3282:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788845299.542198:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.135@tcp: connect to target with instance 0 00000100:00080000:2.0:1788845299.542209:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788845299.542214:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788845299.542218:0:3282:0:(import.c:65:import_set_state_nolock()) 00000000ffb3146a MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788845299.542221:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788845299.542232:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788845299.542237:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002406ff9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3282:1875740189524096:0@lo:250: 00000100:00100000:1.0:1788845299.546012:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788845299.546297:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788845299.546304:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788845299.547310:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788845299.547318:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788845299.548846:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788845299.548855:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00010000:00010000:2.0:1788845299.548925:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845299.551667:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845299.552544:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788845299.552552:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788845299.554726:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788845299.554737:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788845299.612058:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788845299.612241:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788845299.612246:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788845299.613143:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788845299.613153:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788845299.613818:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788845299.613976:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788845299.613980:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788845299.614551:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788845299.614558:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788845299.616284:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845299.616667:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788845299.616674:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788845299.618963:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788845299.618981:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788845299.620061:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845299.620613:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788845299.620621:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788845299.622328:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788845299.622342:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788845299.653164:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788845299.654058:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788845299.654067:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788845299.657318:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788845299.657344:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788845299.659022:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788845299.659038:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788845299.660213:0:5798:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788845299.660240:0:5798:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788845299.660247:0:5798:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788845299.661579:0:5798:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788845299.661629:0:5798:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.135@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788845299.661635:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788845299.661637:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788845299.661638:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845299.661639:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845299.661641:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845299.661642:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845299.661644:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788845299.661645:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788845299.661646:0:5798:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788845299.661648:0:5798:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788845299.661650:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845299.661651:0:5798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788845299.661654:0:5798:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788845299.661656:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788845299.661657:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788845299.661662:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845299.661664:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845299.661665:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845299.661666:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845299.661667:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788845299.661668:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788845299.661668:0:5798:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788845299.661669:0:5798:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788845299.661670:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845299.661671:0:5798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788845299.661719:0:5798:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788845299.661739:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021e84ba1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524224:0@lo:253: 00000100:00100000:2.0:1788845299.661851:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845299.662102:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f3859c1e going to sleep for 11 seconds 00000100:00100000:1.0:1788845299.662203:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189524224 00000100:00100000:1.0:1788845299.662213:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189524224 00000100:00100000:1.0:1788845299.662309:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845299.662319:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d286a8c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:5798:x1875740189524224:12345-0@lo:253: 20000000:01000000:1.0:1788845299.662432:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788845299.662436:0:5812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788845299.662870:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788845299.662982:0:5812:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788845299.663353:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845299.664631:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788845299.664977:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788845299.664982:0:5812:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788845299.664989:0:5812:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788845299.664994:0:5812:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788845299.665012:0:5812:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788845299.665241:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788845299.667790:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788845299.667830:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788845299.667938:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788845299.667992:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788845299.668034:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788845299.668179:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788845299.668189:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788845299.668235:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788845299.668244:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788845299.668277:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788845299.668284:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788845299.668315:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788845299.669515:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788845299.669594:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788845299.669601:0:5812:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788845299.669612:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788845299.669892:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788845299.669905:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788845299.669955:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788845299.669992:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788845299.670042:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788845299.670055:0:5812:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788845299.670130:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788845299.670139:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788845299.670200:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788845299.670239:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788845299.670274:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788845299.670286:0:5812:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788845299.671698:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788845299.671723:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788845299.671804:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788845299.671836:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788845299.677684:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788845299.677840:0:5812:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788845299.677849:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788845299.679769:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788845299.680204:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788845299.680236:0:5812:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.135@tcp for mdt 20000000:01000000:0.0:1788845299.680239:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.135@tcp (null) (null) (null) 00000040:00080000:0.0:1788845299.680279:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788845299.680288:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788845299.680320:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788845299.680328:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.135@tcp (null) (null) 00000040:00080000:0.0:1788845299.680404:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788845299.680416:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788845299.680538:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788845299.680574:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788845299.680641:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788845299.680645:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788845299.680652:0:5812:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788845299.680659:0:5812:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788845299.682052:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1788845299.682211:0:5812:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788845299.697629:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788845299.697715:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1788845299.697813:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1788845299.697835:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788845299.697838:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788845299.697842:0:5812:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788845299.697863:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788845299.697866:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788845299.698666:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788845299.698670:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788845299.700914:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788845299.701702:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788845299.701751:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788845299.701793:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788845299.701806:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788845299.701809:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788845299.703343:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1788845299.704065:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1788845299.704116:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1788845299.704208:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1788845299.704223:0:5812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788845299.704226:0:5812:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1788845299.704234:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788845299.704256:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f5452692/0xd8041b54d6df945c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845299.704277:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5452692/0xd8041b54d6df945c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845299.704290:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f5452692/0xd8041b54d6df945c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845299.704296:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f5452692/0xd8041b54d6df945c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845299.704302:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f5452692/0xd8041b54d6df945c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845299.704308:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f5452692/0xd8041b54d6df945c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845299.704313:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f5452692 already unused, calling callback (0000000049595516) 00010000:00010000:1.0:1788845299.704317:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f5452692/0xd8041b54d6df945c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845299.704325:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f5452692/0xd8041b54d6df945c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845299.704340:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f5452692/0xd8041b54d6df945c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845299.704347:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f5452692/0xd8041b54d6df945c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845299.704358:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f5452692/0xd8041b54d6df945c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788845299.704408:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788845300.052271:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d286a8c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:5798:x1875740189524224:12345-0@lo:253: Request processed in 389943us (390410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845300.052291:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845300.052440:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021e84ba1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524224:0@lo:253: 10000000:01000000:3.0:1788845300.052458:0:5798:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788845300.052462:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788845300.052464:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788845300.052465:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845300.052466:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788845300.052467:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845300.052469:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845300.052470:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788845300.052471:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788845300.052473:0:5798:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788845300.052474:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845300.052476:0:5798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788845300.052500:0:5798:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000001d8c3e5 from lustre-MDT0000 10000000:01000000:3.0:1788845300.052530:0:5798:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788845300.052533:0:5798:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788845300.052538:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff92ae8ff0cd28 10000000:01000000:3.0:1788845300.052542:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845300.052553:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92ae8ff0cd28 from 1 10000000:01000000:3.0:1788845300.052557:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788845300.052632:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 00000000f5b55982/0xd8041b54d6df9463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845300.052656:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 00000000f5b55982/0xd8041b54d6df9463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845300.052676:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 00000000f5b55982/0xd8041b54d6df9463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845300.052697:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d33a529 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524352:0@lo:101: 00000100:00100000:3.0:1788845300.052775:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845300.052845:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d359ad7 going to sleep for 11 seconds 00000100:00100000:0.0:1788845300.052965:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189524352 00000100:00100000:0.0:1788845300.052974:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189524352 00000100:00100000:0.0:1788845300.053023:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788845300.053030:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d8fd906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:5798:x1875740189524352:12345-0@lo:101: 00010000:00010000:0.0:1788845300.053046:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845300.053061:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019fd82dd/0xd8041b54d6df946a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9463 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.053099:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019fd82dd/0xd8041b54d6df946a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9463 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.053110:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019fd82dd/0xd8041b54d6df946a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9463 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.053120:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019fd82dd, rc 0) 00000100:00100000:0.0:1788845300.053160:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d8fd906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+6:5798:x1875740189524352:12345-0@lo:101: Request processed in 130us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845300.053166:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845300.053406:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d33a529 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524352:0@lo:101: 00010000:00010000:3.0:1788845300.053436:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 00000000f5b55982/0xd8041b54d6df9463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845300.053446:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 00000000f5b55982/0xd8041b54d6df9463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845300.053498:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d33a529 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524480:0@lo:501: 00000100:00100000:3.0:1788845300.053527:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845300.053558:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d359ad7 going to sleep for 11 seconds 00000100:00100000:1.0:1788845300.053612:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189524480 00000100:00100000:1.0:1788845300.053618:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189524480 00000100:00100000:1.0:1788845300.053660:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845300.053666:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce55c1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+6:5798:x1875740189524480:12345-0@lo:501: 00000100:00100000:1.0:1788845300.053937:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce55c1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+6:5798:x1875740189524480:12345-0@lo:501: Request processed in 270us (409us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788845300.053944:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845300.054189:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d33a529 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524480:0@lo:501: 10000000:01000000:3.0:1788845300.054219:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788845300.054237:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 00000000f5b55982/0xd8041b54d6df9463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845300.054245:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 00000000f5b55982/0xd8041b54d6df9463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845300.054253:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92ae90de3800 10000000:01000000:3.0:1788845300.054257:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788845300.054268:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92ae90de3800 10000000:01000000:3.0:1788845300.054270:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788845300.054273:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92ae90de3800 from 1 10000000:01000000:3.0:1788845300.054275:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788845300.054298:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 00000000f39d6ffc/0xd8041b54d6df9471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845300.054304:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 00000000f39d6ffc/0xd8041b54d6df9471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845300.054312:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 00000000f39d6ffc/0xd8041b54d6df9471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845300.054324:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d33a529 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524608:0@lo:101: 00000100:00100000:3.0:1788845300.054352:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845300.054424:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d359ad7 going to sleep for 11 seconds 00000100:00100000:1.0:1788845300.054832:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189524608 00000100:00100000:1.0:1788845300.054838:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189524608 00000100:00100000:1.0:1788845300.054887:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788845300.054897:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c83dcd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+6:5798:x1875740189524608:12345-0@lo:101: 00010000:00010000:1.0:1788845300.054909:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845300.054924:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5452692/0xd8041b54d6df9478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9471 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.054945:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5452692/0xd8041b54d6df9478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9471 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.054954:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5452692/0xd8041b54d6df9478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9471 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.054975:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5452692, rc 0) 00000100:00100000:1.0:1788845300.055022:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c83dcd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+7:5798:x1875740189524608:12345-0@lo:101: Request processed in 127us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845300.055029:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845300.055132:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d33a529 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524608:0@lo:101: 00010000:00010000:0.0:1788845300.055144:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 00000000f39d6ffc/0xd8041b54d6df9471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.055152:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 00000000f39d6ffc/0xd8041b54d6df9471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845300.055167:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788845300.055176:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 00000000f39d6ffc/0xd8041b54d6df9471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.055182:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 00000000f39d6ffc/0xd8041b54d6df9471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845300.055188:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788845300.055191:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788845300.055196:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92ae90de3800 10000000:01000000:0.0:1788845300.055199:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788845300.055207:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788845300.055209:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788845300.055229:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 00000000061e6dec/0xd8041b54d6df947f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.055235:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 00000000061e6dec/0xd8041b54d6df947f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.055242:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 00000000061e6dec/0xd8041b54d6df947f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845300.055256:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e584083b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524736:0@lo:101: 00000100:00100000:0.0:1788845300.055286:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845300.055302:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091668870 going to sleep for 11 seconds 00000100:00100000:0.0:1788845300.055321:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189524736 00000100:00100000:0.0:1788845300.055325:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189524736 00000100:00100000:0.0:1788845300.055350:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845300.055355:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adfd4296 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+7:5798:x1875740189524736:12345-0@lo:101: 00010000:00010000:0.0:1788845300.055386:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845300.055406:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f3bcc907/0xd8041b54d6df9486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df947f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.055714:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f3bcc907/0xd8041b54d6df9486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df947f expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.055723:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f3bcc907/0xd8041b54d6df9486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df947f expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.055730:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f3bcc907, rc 0) 00000100:00100000:0.0:1788845300.055778:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adfd4296 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+8:5798:x1875740189524736:12345-0@lo:101: Request processed in 422us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845300.055791:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845300.055833:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e584083b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524736:0@lo:101: 00010000:00010000:0.0:1788845300.055844:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 00000000061e6dec/0xd8041b54d6df947f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.055851:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 00000000061e6dec/0xd8041b54d6df947f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845300.055900:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e584083b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524864:0@lo:501: 00000100:00100000:0.0:1788845300.055925:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845300.055949:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091668870 going to sleep for 11 seconds 00000100:00100000:0.0:1788845300.055963:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189524864 00000100:00100000:0.0:1788845300.055966:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189524864 00000100:00100000:0.0:1788845300.055988:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845300.055994:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f93cd9c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+8:5798:x1875740189524864:12345-0@lo:501: 00000100:00100000:0.0:1788845300.057104:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f93cd9c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+9:5798:x1875740189524864:12345-0@lo:501: Request processed in 1105us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845300.057115:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845300.057218:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e584083b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524864:0@lo:501: 00000100:00100000:1.0:1788845300.057283:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4c25194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524992:0@lo:503: 00000100:00100000:1.0:1788845300.057335:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845300.057521:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e490efd going to sleep for 11 seconds 00000100:00100000:0.0:1788845300.057629:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189524992 00000100:00100000:0.0:1788845300.057693:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189524992 00000100:00100000:0.0:1788845300.057781:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788845300.057789:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000814c2824 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+9:5798:x1875740189524992:12345-0@lo:503: 00000100:00100000:0.0:1788845300.057985:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000814c2824 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+9:5798:x1875740189524992:12345-0@lo:503: Request processed in 197us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845300.057993:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788845300.058065:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4c25194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189524992:0@lo:503: 00000100:00100000:3.0:1788845300.059017:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000029fce464 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5840:1875740189525120:0@lo:502: 00000100:00100000:3.0:1788845300.059087:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845300.059169:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d00e40e6 going to sleep for 11 seconds 00000100:00100000:0.0:1788845300.059212:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189525120 00000100:00100000:0.0:1788845300.059224:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189525120 00000100:00100000:0.0:1788845300.059302:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845300.059311:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022706746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+9:5840:x1875740189525120:12345-0@lo:502: 00000100:00100000:0.0:1788845300.059577:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022706746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+9:5840:x1875740189525120:12345-0@lo:502: Request processed in 267us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845300.059585:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788845300.059683:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000029fce464 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5840:1875740189525120:0@lo:502: 00000020:01000000:1.0:1788845300.059715:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845300.059728:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845300.059731:0:5840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788845300.059737:0:5840:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788845300.059740:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788845300.059772:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000666b657b) 00000020:00000080:1.0:1788845300.059793:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788845300.059801:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788845300.059877:0:5840:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788845300.059885:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6df9494 00000020:00000080:1.0:1788845300.060134:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788845300.060139:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845300.060142:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845300.060144:0:5840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788845300.060147:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845300.060150:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845300.060156:0:5840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788845300.060161:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788845300.060166:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e28f3778) 00000020:00000080:1.0:1788845300.060176:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788845300.060179:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788845300.060181:0:5840:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788845300.060184:0:5840:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788845300.060189:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788845300.060230:0:5840:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000001d8c3e5 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788845300.060244:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a015c53f) 00000020:00000080:1.0:1788845300.060251:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788845300.060317:0:5840:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788845300.060324:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd8041b54d6df94a9 00000020:00000080:1.0:1788845300.060466:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788845300.060473:0:5840:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788845300.060478:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd8041b54d6df94b0 00080000:01000000:1.0:1788845300.060483:0:5840:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788845300.060487:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6df94b7 00080000:10000000:1.0:1788845300.060925:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788845300.061139:0:5840:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788845300.075952:0:5840:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788845300.210137:0:5840:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788845300.210794:0:5840:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788845300.217248:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788845300.219073:0:5840:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788845300.270530:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000cd923ec3) 00000020:00000080:3.0:1788845300.270557:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788845300.270675:0:5840:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788845300.270684:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6df94c5 00000020:00000080:2.0:1788845300.274029:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788845300.275520:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845300.331065:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788845300.384679:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845300.407707:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788845300.449882:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845300.483132:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788845300.520547:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd8041b54d6df94cc 00000020:00000080:1.0:1788845300.521528:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788845300.521540:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845300.521547:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845300.521549:0:5840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788845300.521552:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845300.521558:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845300.521560:0:5840:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788845300.521564:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788845300.521623:0:5840:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788845300.521638:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845300.521641:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845300.521643:0:5840:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788845300.521645:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845300.521648:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845300.521649:0:5840:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788845300.521652:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788845300.521654:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788845300.521696:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4c25194 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5840:1875740189525248:0@lo:502: 00000100:00100000:1.0:1788845300.521799:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845300.521875:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d22a8be going to sleep for 11 seconds 00000100:00100000:0.0:1788845300.521928:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189525248 00000100:00100000:0.0:1788845300.521936:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189525248 00000100:00100000:0.0:1788845300.521972:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845300.521979:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010d66854 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+9:5840:x1875740189525248:12345-0@lo:502: 00000100:00100000:0.0:1788845300.522442:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010d66854 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+9:5840:x1875740189525248:12345-0@lo:502: Request processed in 463us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845300.522451:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788845300.522653:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4c25194 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5840:1875740189525248:0@lo:502: 00000020:01000000:1.0:1788845300.522683:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845300.522689:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845300.522691:0:5840:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788845300.522695:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788845300.522798:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788845300.522823:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788845300.522844:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 00000000061e6dec/0xd8041b54d6df947f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.522855:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 00000000061e6dec/0xd8041b54d6df947f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845300.522862:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ae90de3800 from 1 10000000:01000000:0.0:1788845300.522865:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788845300.522891:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.522898:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.522918:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845300.522932:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b61a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189525376:0@lo:101: 00000100:00100000:0.0:1788845300.522964:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845300.522995:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e5b2f7ac going to sleep for 11 seconds 00000100:00100000:1.0:1788845300.524045:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189525376 00000100:00100000:1.0:1788845300.524052:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189525376 00000100:00100000:1.0:1788845300.524201:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845300.524381:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d04c6dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+9:5798:x1875740189525376:12345-0@lo:101: 00010000:00010000:1.0:1788845300.524396:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845300.524412:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ae768dd/0xd8041b54d6df94da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df94d3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.525326:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ae768dd/0xd8041b54d6df94da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df94d3 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.525339:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ae768dd/0xd8041b54d6df94da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df94d3 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.525387:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ae768dd, rc 0) 00000100:00100000:1.0:1788845300.525656:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d04c6dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:5798:x1875740189525376:12345-0@lo:101: Request processed in 1447us (2692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845300.525663:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845300.526853:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b61a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189525376:0@lo:101: 00010000:00010000:0.0:1788845300.526930:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.526941:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845300.527994:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b61a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189525504:0@lo:256: 00000100:00100000:0.0:1788845300.528054:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845300.528106:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e5b2f7ac going to sleep for 11 seconds 00000100:00100000:2.0:1788845300.528342:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189525504 00000100:00100000:2.0:1788845300.528348:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189525504 00000100:00100000:2.0:1788845300.528419:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788845300.528428:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c18525af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:5798:x1875740189525504:12345-0@lo:256: 20000000:01000000:2.0:1788845300.528448:0:5811:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788845300.528472:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788845300.528552:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c18525af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:5798:x1875740189525504:12345-0@lo:256: Request processed in 126us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845300.528560:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788845300.528795:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b61a66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189525504:0@lo:256: 10000000:01000000:0.0:1788845300.530588:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788845300.530612:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.530624:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845300.531356:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ae90de3800 from 1 10000000:01000000:1.0:1788845300.531396:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845300.531435:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.531446:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.531456:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845300.531476:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4c25194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189525632:0@lo:101: 00000100:00100000:1.0:1788845300.531537:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845300.532379:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189525632 00000100:00100000:0.0:1788845300.532387:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189525632 00000100:00100000:0.0:1788845300.532442:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845300.532449:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d95b7c18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:5798:x1875740189525632:12345-0@lo:101: 00000100:00100000:1.0:1788845300.532470:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 000000001403f898 going to sleep for 11 seconds 00010000:00010000:0.0:1788845300.532820:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845300.532837:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000c6c22d/0xd8041b54d6df94e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df94e1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.532861:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000c6c22d/0xd8041b54d6df94e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df94e1 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.532977:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000c6c22d/0xd8041b54d6df94e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df94e1 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.532987:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000c6c22d, rc 0) 00000100:00100000:0.0:1788845300.533042:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d95b7c18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5798:x1875740189525632:12345-0@lo:101: Request processed in 593us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845300.533049:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788845300.533097:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4c25194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189525632:0@lo:101: 00010000:00010000:1.0:1788845300.533111:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.533120:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845300.533200:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4c25194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189525760:0@lo:501: 00000100:00100000:1.0:1788845300.533228:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845300.533263:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 000000001403f898 going to sleep for 11 seconds 00000100:00100000:2.0:1788845300.533543:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189525760 00000100:00100000:2.0:1788845300.533549:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189525760 00000100:00100000:2.0:1788845300.533588:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845300.533595:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000513cbfd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5798:x1875740189525760:12345-0@lo:501: 00000100:00100000:2.0:1788845300.535041:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000513cbfd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5798:x1875740189525760:12345-0@lo:501: Request processed in 1443us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845300.535052:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788845300.535183:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4c25194 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189525760:0@lo:501: 00000100:00100000:3.0:1788845300.535300:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edd014d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189525888:0@lo:503: 00000100:00100000:3.0:1788845300.535346:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845300.535456:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d4abb84 going to sleep for 11 seconds 00000100:00100000:2.0:1788845300.536997:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189525888 00000100:00100000:2.0:1788845300.537016:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189525888 00000100:00100000:2.0:1788845300.537070:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845300.537078:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f5043c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5798:x1875740189525888:12345-0@lo:503: 00000040:00080000:2.0:1788845300.537143:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788845300.537221:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f5043c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5798:x1875740189525888:12345-0@lo:503: Request processed in 144us (1876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845300.537229:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788845300.537321:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edd014d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189525888:0@lo:503: 00000040:00080000:0.0:1788845300.539128:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788845300.539302:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788845300.539328:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788845300.539349:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.539401:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845300.539453:0:5798:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788845300.539619:0:5798:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92ae90de3800 10000000:01000000:1.0:1788845300.539624:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92ae90de3800 10000000:01000000:1.0:1788845300.539629:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788845300.539635:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ae90de3800 from 1 10000000:01000000:1.0:1788845300.539638:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788845300.539671:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 00000000ad3b908a/0xd8041b54d6df94ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.539680:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 00000000ad3b908a/0xd8041b54d6df94ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.539689:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 00000000ad3b908a/0xd8041b54d6df94ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845300.539709:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c49d0da4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189526016:0@lo:101: 00000100:00100000:1.0:1788845300.539779:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845300.539827:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e03ee22 going to sleep for 11 seconds 00000100:00100000:3.0:1788845300.540172:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189526016 00000100:00100000:3.0:1788845300.540193:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189526016 00000100:00100000:3.0:1788845300.540234:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845300.540241:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f9ec58a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5798:x1875740189526016:12345-0@lo:101: 00010000:00010000:3.0:1788845300.540253:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845300.540266:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a4d3e17/0xd8041b54d6df94f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df94ef expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845300.540306:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a4d3e17/0xd8041b54d6df94f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df94ef expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845300.540316:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a4d3e17/0xd8041b54d6df94f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df94ef expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845300.540325:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a4d3e17, rc 0) 00000100:00100000:3.0:1788845300.540700:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f9ec58a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5798:x1875740189526016:12345-0@lo:101: Request processed in 458us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845300.540708:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788845300.540803:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c49d0da4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189526016:0@lo:101: 00010000:00010000:1.0:1788845300.540829:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 00000000ad3b908a/0xd8041b54d6df94ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.540846:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 00000000ad3b908a/0xd8041b54d6df94ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845300.540902:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c49d0da4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189526144:0@lo:501: 00000100:00100000:1.0:1788845300.540931:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845300.540967:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e03ee22 going to sleep for 11 seconds 00000100:00100000:2.0:1788845300.541083:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189526144 00000100:00100000:2.0:1788845300.541089:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189526144 00000100:00100000:2.0:1788845300.541120:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845300.541127:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008478be95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5798:x1875740189526144:12345-0@lo:501: 00000100:00100000:3.0:1788845300.542346:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008478be95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5798:x1875740189526144:12345-0@lo:501: Request processed in 1216us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845300.542356:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788845300.542640:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c49d0da4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189526144:0@lo:501: 00000100:00100000:1.0:1788845300.542683:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c49d0da4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189526272:0@lo:503: 00000100:00100000:1.0:1788845300.542732:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845300.542813:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e03ee22 going to sleep for 11 seconds 00000100:00100000:3.0:1788845300.542896:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189526272 00000100:00100000:3.0:1788845300.542901:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189526272 00000100:00100000:2.0:1788845300.543196:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788845300.543207:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e77df6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5798:x1875740189526272:12345-0@lo:503: 00000100:00100000:2.0:1788845300.544793:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e77df6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5798:x1875740189526272:12345-0@lo:503: Request processed in 1583us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845300.544816:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788845300.545045:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c49d0da4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189526272:0@lo:503: 00000100:00100000:3.0:1788845300.545615:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bee15e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5845:1875740189526400:0@lo:502: 00000100:00100000:3.0:1788845300.545669:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845300.546637:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038318f09 going to sleep for 11 seconds 00000100:00100000:0.0:1788845300.547788:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189526400 00000100:00100000:0.0:1788845300.547798:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189526400 00000100:00100000:1.0:1788845300.548098:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788845300.548108:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4d741e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5845:x1875740189526400:12345-0@lo:502: 00000100:00100000:1.0:1788845300.548540:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4d741e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5845:x1875740189526400:12345-0@lo:502: Request processed in 433us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845300.548620:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788845300.548834:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bee15e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5845:1875740189526400:0@lo:502: 00000020:01000004:3.0:1788845300.548979:0:5845:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788845300.548999:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007399456f) 00000020:00000080:3.0:1788845300.549019:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788845300.549134:0:5845:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000001d8c3e5 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788845300.549138:0:5845:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000001d8c3e5 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788845300.549141:0:5845:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000001d8c3e5 4 00010000:00080000:3.0:1788845300.550732:0:5845:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ce04abee@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:3.0:1788845300.554850:0:5845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788845300.555317:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788845300.555357:0:5845:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788845300.555392:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd8041b54d6df9504 00000100:00080000:3.0:1788845300.555405:0:5845:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788845300.555410:0:5845:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ce04abee using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1788845300.555443:0:5845:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005bee15e1 x1875740189526528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788845300.555474:0:5845:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788845300.555509:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bee15e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875740189526528:0@lo:38: 00000100:00100000:0.0:1788845300.555599:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845300.556900:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189526528 00000100:00100000:3.0:1788845300.556909:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189526528 00000100:00100000:3.0:1788845300.556958:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845300.556965:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b61a66d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875740189526528:12345-0@lo:38: 00000100:00100000:3.0:1788845300.557040:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b61a66d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875740189526528:12345-0@lo:38: Request processed in 74us (1442us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788845300.557049:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845300.557056:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788845300.557066:0:3282:0:(import.c:65:import_set_state_nolock()) 00000000ce04abee lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788845300.557071:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788845300.557077:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bee15e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875740189526528:0@lo:38: 00000100:00100000:3.0:1788845300.557161:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e5f3677 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5845:1875740189526656:0@lo:502: 00000100:00100000:3.0:1788845300.557813:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845300.557859:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d4abb84 going to sleep for 11 seconds 00000100:00100000:0.0:1788845300.558398:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189526656 00000100:00100000:0.0:1788845300.558405:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189526656 00000100:00100000:0.0:1788845300.558442:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788845300.558449:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f48e578 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5845:x1875740189526656:12345-0@lo:502: 00000100:00100000:0.0:1788845300.558712:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f48e578 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5845:x1875740189526656:12345-0@lo:502: Request processed in 262us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845300.558719:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788845300.558800:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e5f3677 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5845:1875740189526656:0@lo:502: 00000040:00080000:2.0:1788845300.558831:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788845300.559050:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788845300.559076:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845300.559094:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 00000000ad3b908a/0xd8041b54d6df94ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.559105:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 00000000ad3b908a/0xd8041b54d6df94ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788845300.559147:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788845300.559149:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788845300.559151:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845300.559152:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845300.559153:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845300.559155:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845300.559156:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788845300.559158:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788845300.559159:0:5798:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845300.559160:0:5798:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845300.559162:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845300.559163:0:5798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845300.559167:0:5798:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788845300.559170:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788845300.559171:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788845300.559172:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845300.559173:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845300.559174:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845300.559175:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845300.559176:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788845300.559177:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788845300.559178:0:5798:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845300.559179:0:5798:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845300.559180:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845300.559187:0:5798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845300.559206:0:5798:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788845300.559218:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3f1a509 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189526784:0@lo:253: 00000100:00100000:0.0:1788845300.559266:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845300.559308:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9fb5ca2 going to sleep for 11 seconds 00000100:00100000:3.0:1788845300.560271:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189526784 00000100:00100000:3.0:1788845300.560279:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189526784 00000100:00100000:3.0:1788845300.560322:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788845300.560330:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a360a208 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5798:x1875740189526784:12345-0@lo:253: 20000000:01000000:3.0:1788845300.560358:0:5810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788845300.560397:0:5810:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1788845300.571994:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1788845300.597917:0:5810:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788845300.597941:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788845300.598012:0:5833:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788845300.598018:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788845300.598045:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845300.598068:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009ae768dd/0xd8041b54d6df94da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df94d3 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845300.598076:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845300.598122:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009ae768dd/0xd8041b54d6df94da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df94d3 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845300.598139:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009ae768dd/0xd8041b54d6df94da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df94d3 expref: 12 pid: 5810 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845300.598153:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ccf53a93 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875740189526912:0@lo:104: 00000100:00100000:2.0:1788845300.598225:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845300.598285:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036f37bb4 going to sleep for 11 seconds 00000100:00100000:1.0:1788845300.598900:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189526912 00000100:00100000:1.0:1788845300.598912:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189526912 00000100:00100000:1.0:1788845300.598968:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845300.598977:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1624b13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:5833:x1875740189526912:12345-0@lo:104: 00010000:00010000:1.0:1788845300.598991:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599083:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788845300.599089:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1624b13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:5833:x1875740189526912:12345-0@lo:104: Request processed in 114us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845300.599096:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788845300.599118:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845300.599123:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599130:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009a565130 already unused, calling callback (0000000019fbebff) 10000000:00010000:1.0:1788845300.599134:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599141:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845300.599148:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845300.599153:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845300.599185:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599191:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845300.599207:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599213:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: 000000009a565130/0xd8041b54d6df94d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df94da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599242:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845300.599244:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845300.599245:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845300.599302:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845300.599313:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c49d0da4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189527040:0@lo:103: 00000100:00100000:1.0:1788845300.599344:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845300.599446:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189527040 00000100:00100000:1.0:1788845300.599450:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189527040 00010000:00010000:1.0:1788845300.599467:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009ae768dd/0xd8041b54d6df94da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df94d3 expref: 13 pid: 5810 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845300.599490:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845300.599496:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf756d5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:3283:x1875740189527040:12345-0@lo:103: 00010000:00010000:1.0:1788845300.599507:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845300.599511:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009ae768dd/0xd8041b54d6df94da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df94d3 expref: 13 pid: 5810 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599520:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009ae768dd/0xd8041b54d6df94da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df94d3 expref: 13 pid: 5810 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599536:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599543:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788845300.599556:0:5802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001539629s 00010000:00010000:1.0:1788845300.599560:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599575:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599581:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599585:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599589:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000136fcef5 already unused, calling callback (0000000049595516) 00010000:00010000:1.0:1788845300.599592:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599598:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599604:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845300.599612:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845300.599638:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf756d5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:3283:x1875740189527040:12345-0@lo:103: Request processed in 143us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845300.599644:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845300.599676:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c49d0da4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189527040:0@lo:103: 00010000:00010000:0.0:1788845300.599935:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009ae768dd/0xd8041b54d6df94da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df94d3 expref: 12 pid: 5810 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845300.599947:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ccf53a93 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875740189526912:0@lo:104: 00010000:00010000:0.0:1788845300.599961:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.599968:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.599973:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845300.599977:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000136fcef5/0xd8041b54d6df950b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845300.606640:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a360a208 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5798:x1875740189526784:12345-0@lo:253: Request processed in 46299us (47361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845300.606660:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788845300.606803:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3f1a509 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5798:1875740189526784:0@lo:253: 10000000:01000000:0.0:1788845300.606822:0:5798:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788845300.606825:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788845300.606828:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788845300.606830:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845300.606831:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845300.606833:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845300.606834:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845300.606835:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788845300.606837:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788845300.606839:0:5798:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845300.606841:0:5798:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845300.606861:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845300.606863:0:5798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788845300.606884:0:5798:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788845300.612335:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845300.613346:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788845300.613944:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845300.614126:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788845300.614344:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845300.614674:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788845300.615818:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845300.616029:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788845300.616263:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845300.616500:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788845300.616747:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845300.616948:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788845300.698054:0:5798:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788845300.747173:0:5798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788845300.747608:0:5850:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788845300.747613:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788845300.748100:0:5851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788845300.761648:0:5798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788845300.765862:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788845300.766593:0:5798:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788845300.766606:0:5798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788845300.766834:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845300.770112:0:5798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788845300.771666:0:5798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788845300.771743:0:5798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788845300.773523:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788845300.774118:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788845300.778541:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788845300.778743:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788845300.779233:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788845300.779436:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788845300.779593:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788845300.779778:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788845300.780174:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788845300.780317:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788845300.780587:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788845300.780789:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788845300.782189:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788845300.782469:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788845300.782628:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788845300.788459:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788845300.789317:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788845300.789531:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788845300.789866:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788845300.790149:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788845300.790716:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788845300.790865:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788845300.793305:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788845300.793660:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788845300.793833:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788845300.793962:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788845300.794536:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788845300.794658:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788845300.794823:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788845300.795635:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788845300.795809:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788845300.795954:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788845300.797314:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788845300.799861:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788845300.801971:0:5798:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788845300.866736:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788845300.945777:0:5798:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788845300.945825:0:5798:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf3e01d5b988 00100000:10000000:1.0:1788845300.945836:0:5798:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:2.0:1788845300.949850:0:5851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788845300.949978:0:5851:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788845300.949982:0:5851:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:0.0:1788845300.951147:0:5798:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788845300.951167:0:5798:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788845300.951181:0:5798:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788845300.951225:0:5798:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788845301.596702:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845302.619588:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845303.643862:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788845304.112546:0:6094:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788845304.669895:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788845304.928031:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788845304.928041:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ae90de3800 from 3 10000000:01000000:3.0:1788845304.928048:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788845304.928103:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 00000000d6334897/0xd8041b54d6df9512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845304.928118:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 00000000d6334897/0xd8041b54d6df9512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845304.928141:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 00000000d6334897/0xd8041b54d6df9512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845304.928168:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000522baf3f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189527168:0@lo:101: 00000100:00100000:3.0:1788845304.928244:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845304.928341:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042b2fb14 going to sleep for 11 seconds 00000100:00100000:2.0:1788845304.932022:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189527168 00000100:00100000:2.0:1788845304.932042:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189527168 00000100:00100000:2.0:1788845304.932107:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845304.932118:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cc970c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5814:x1875740189527168:12345-0@lo:101: 00010000:00010000:2.0:1788845304.932143:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845304.932166:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ac5888c/0xd8041b54d6df9519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9512 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845304.932199:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ac5888c/0xd8041b54d6df9519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9512 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845304.932211:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ac5888c/0xd8041b54d6df9519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9512 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845304.932222:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ac5888c, rc 0) 00000100:00100000:2.0:1788845304.932305:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cc970c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189527168:12345-0@lo:101: Request processed in 190us (4062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845304.932313:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845304.932967:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000522baf3f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189527168:0@lo:101: 00010000:00010000:2.0:1788845304.932992:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 00000000d6334897/0xd8041b54d6df9512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845304.933004:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 00000000d6334897/0xd8041b54d6df9512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845304.933077:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035c2f263 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189527296:0@lo:256: 00000100:00100000:2.0:1788845304.933132:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845304.934444:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069eb4935 going to sleep for 11 seconds 00000100:00100000:1.0:1788845304.937096:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189527296 00000100:00100000:1.0:1788845304.937117:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189527296 00000100:00100000:1.0:1788845304.937179:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788845304.937187:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd3dd369 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189527296:12345-0@lo:256: 20000000:01000000:1.0:1788845304.937220:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788845304.937237:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788845304.937240:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788845304.938041:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035c2f263 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189527296:0@lo:256: 10000000:01000000:2.0:1788845304.938102:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788845304.938113:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 00000000d6334897/0xd8041b54d6df9512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845304.938125:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 00000000d6334897/0xd8041b54d6df9512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845304.938189:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd3dd369 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189527296:12345-0@lo:256: Request processed in 1002us (5056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845304.938198:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788845305.692213:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788845305.947588:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788845305.947599:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788845305.947601:0:38:0:(import.c:65:import_set_state_nolock()) 00000000ce04abee lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788845305.947613:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ce04abee using connection 192.168.206.135@tcp/0@lo 00000100:00100000:0.0:1788845305.947633:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004de58ebe x1875740189527552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788845305.947739:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004de58ebe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875740189527552:0@lo:38: 00000100:00100000:3.0:1788845305.947817:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845305.947982:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845305.947990:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3f1a509 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189527424:0@lo:400: 00000100:00100000:2.0:1788845305.948023:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845305.948097:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189527424 00000100:00100000:3.0:1788845305.948105:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189527424 00000100:00100000:3.0:1788845305.948149:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788845305.948157:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000697a020e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3286:x1875740189527424:12345-0@lo:400: 00000100:00100000:3.0:1788845305.948206:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000697a020e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3286:x1875740189527424:12345-0@lo:400: Request processed in 51us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845305.948214:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788845305.948257:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3f1a509 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189527424:0@lo:400: 00000100:00100000:0.0:1788845305.948378:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189527552 00000100:00100000:0.0:1788845305.948383:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189527552 00000100:00100000:0.0:1788845305.948411:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845305.948415:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034d3822f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875740189527552:12345-0@lo:38: 00010000:00080000:0.0:1788845305.948434:0:5819:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 115 last 0 00000020:00000080:0.0:1788845305.948467:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd8041b54d6df9520 00000004:00100000:0.0:1788845305.948512:0:5819:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788845305.948620:0:5819:0:(import.c:65:import_set_state_nolock()) 000000002d1bd246 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845305.948670:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034d3822f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875740189527552:12345-0@lo:38: Request processed in 253us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845305.948675:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788845305.948789:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004de58ebe x1875740189527552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788845305.948802:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788845305.948809:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788845305.948814:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788845305.948816:0:3282:0:(import.c:65:import_set_state_nolock()) 00000000ce04abee lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788845305.948820:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004de58ebe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875740189527552:0@lo:38: 00010000:00010000:2.0:1788845306.720227:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845307.742041:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788845308.275968:0:6295:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceba93cc0 20000000:00000080:1.0:1788845308.275992:0:6295:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92aebc339800 uarg=0000000000000000 20000000:01000000:1.0:1788845308.276033:0:6295:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788845308.276041:0:6295:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788845308.276047:0:6295:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788845308.276626:0:6295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788845308.276728:0:6295:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788845308.282020:0:6295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788845308.282790:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788845308.282865:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788845308.282921:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788845308.282939:0:6295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788845308.282961:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.282982:0:6295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000000c6c22d/0xd8041b54d6df94e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df94e1 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.282991:0:6295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.283040:0:6295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000000c6c22d/0xd8041b54d6df94e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df94e1 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.283057:0:6295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000000c6c22d/0xd8041b54d6df94e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df94e1 expref: 11 pid: 5810 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845308.283073:0:6295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c49d0da4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6295:1875740189527680:0@lo:104: 00000100:00100000:1.0:1788845308.283160:0:6295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845308.283219:0:6295:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edd191b8 going to sleep for 11 seconds 00000100:00100000:2.0:1788845308.283238:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189527680 00000100:00100000:2.0:1788845308.283250:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189527680 00000100:00100000:2.0:1788845308.283400:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845308.283412:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9d7e20b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:6295:x1875740189527680:12345-0@lo:104: 00010000:00010000:2.0:1788845308.283434:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845308.283521:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788845308.283527:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9d7e20b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:6295:x1875740189527680:12345-0@lo:104: Request processed in 117us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845308.283590:0:6295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c49d0da4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6295:1875740189527680:0@lo:104: 00010000:00010000:0.0:1788845308.283612:0:6295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845308.284841:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788845308.284883:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845308.284890:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845308.284902:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008a8d8501 already unused, calling callback (0000000019fbebff) 10000000:00010000:2.0:1788845308.284905:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845308.284915:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845308.284922:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845308.284928:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845308.284980:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845308.284985:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845308.285014:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845308.285019:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: 000000008a8d8501/0xd8041b54d6df94e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df94e8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845308.285030:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845308.285048:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035c2f263 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189527808:0@lo:103: 00010000:00010000:2.0:1788845308.285108:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845308.285111:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845308.285112:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845308.285114:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845308.285204:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189527808 00000100:00100000:1.0:1788845308.285213:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189527808 00010000:00010000:1.0:1788845308.285241:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000000c6c22d/0xd8041b54d6df94e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df94e1 expref: 12 pid: 5810 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845308.285277:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845308.285285:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfd84ab8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3285:x1875740189527808:12345-0@lo:103: 00010000:00010000:1.0:1788845308.285307:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845308.285313:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000000c6c22d/0xd8041b54d6df94e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df94e1 expref: 12 pid: 5810 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285325:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000000c6c22d/0xd8041b54d6df94e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df94e1 expref: 12 pid: 5810 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285339:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000000c6c22d/0xd8041b54d6df94e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df94e1 expref: 12 pid: 5810 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285357:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285537:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285553:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285559:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285565:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285571:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285576:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000063a97373 already unused, calling callback (0000000049595516) 00010000:00010000:1.0:1788845308.285580:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285595:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285616:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845308.285626:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845308.285673:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfd84ab8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:3285:x1875740189527808:12345-0@lo:103: Request processed in 390us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845308.285681:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845308.285730:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035c2f263 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189527808:0@lo:103: 00010000:00010000:2.0:1788845308.285863:0:6295:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845308.285872:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845308.285878:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000063a97373/0xd8041b54d6df9527 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845308.765736:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845309.791674:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788845310.619561:0:5814:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788845310.619569:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ae90de3800 from 1 10000000:01000000:0.0:1788845310.619574:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845310.619617:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 0000000000c6c22d/0xd8041b54d6df952e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845310.619628:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 0000000000c6c22d/0xd8041b54d6df952e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845310.619638:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 0000000000c6c22d/0xd8041b54d6df952e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845310.619661:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0add810 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189527936:0@lo:101: 00000100:00100000:0.0:1788845310.619753:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845310.619808:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000914ba5af going to sleep for 11 seconds 00000100:00100000:1.0:1788845310.619871:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189527936 00000100:00100000:1.0:1788845310.619879:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189527936 00000100:00100000:1.0:1788845310.619938:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788845310.619947:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000922c6f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5814:x1875740189527936:12345-0@lo:101: 00010000:00010000:1.0:1788845310.619959:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845310.619974:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3b46f93/0xd8041b54d6df9535 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df952e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845310.619995:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3b46f93/0xd8041b54d6df9535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df952e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845310.620005:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3b46f93/0xd8041b54d6df9535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df952e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845310.620014:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3b46f93, rc 0) 00000100:00100000:1.0:1788845310.620061:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000922c6f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189527936:12345-0@lo:101: Request processed in 115us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845310.620067:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788845310.620192:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0add810 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189527936:0@lo:101: 00010000:00010000:0.0:1788845310.620206:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 0000000000c6c22d/0xd8041b54d6df952e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845310.620214:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 0000000000c6c22d/0xd8041b54d6df952e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845310.620267:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0add810 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189528064:0@lo:501: 00000100:00100000:0.0:1788845310.620291:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845310.620311:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000914ba5af going to sleep for 11 seconds 00000100:00100000:2.0:1788845310.620354:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189528064 00000100:00100000:2.0:1788845310.620358:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189528064 00000100:00100000:2.0:1788845310.620420:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788845310.620426:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003de1993d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189528064:12345-0@lo:501: 00000100:00100000:2.0:1788845310.620669:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003de1993d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189528064:12345-0@lo:501: Request processed in 243us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845310.620676:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845310.621529:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0add810 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189528064:0@lo:501: 00000100:00100000:0.0:1788845310.621573:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0add810 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189528192:0@lo:503: 00000100:00100000:0.0:1788845310.621628:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845310.621663:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000914ba5af going to sleep for 11 seconds 00000100:00100000:2.0:1788845310.621741:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189528192 00000100:00100000:2.0:1788845310.621748:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189528192 00000100:00100000:2.0:1788845310.621784:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788845310.621791:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064c85f12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189528192:12345-0@lo:503: 00000100:00100000:2.0:1788845310.621956:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064c85f12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189528192:12345-0@lo:503: Request processed in 165us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845310.621964:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788845310.622056:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0add810 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189528192:0@lo:503: 00000100:00100000:1.0:1788845310.622355:0:6444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000795249c7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6444:1875740189528320:0@lo:502: 00000100:00100000:1.0:1788845310.622425:0:6444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845310.622445:0:6444:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069eb4935 going to sleep for 11 seconds 00000100:00100000:2.0:1788845310.622557:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189528320 00000100:00100000:2.0:1788845310.622562:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189528320 00000100:00100000:2.0:1788845310.622587:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788845310.622593:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003af86e43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6444:x1875740189528320:12345-0@lo:502: 00000100:00100000:2.0:1788845310.622742:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003af86e43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6444:x1875740189528320:12345-0@lo:502: Request processed in 149us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845310.622749:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788845310.622819:0:6444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000795249c7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6444:1875740189528320:0@lo:502: 00000020:01000000:1.0:1788845310.622846:0:6444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845310.622856:0:6444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845310.622858:0:6444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788845310.622865:0:6444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ae90de3800 00000020:00000080:1.0:1788845310.622867:0:6444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788845310.622907:0:6444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6444:1875740189528448:0@lo:502: 00000100:00100000:1.0:1788845310.622941:0:6444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845310.622965:0:6444:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ea74840 going to sleep for 11 seconds 00000100:00100000:0.0:1788845310.623029:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189528448 00000100:00100000:0.0:1788845310.623033:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189528448 00000100:00100000:0.0:1788845310.623054:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788845310.623061:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6444:x1875740189528448:12345-0@lo:502: 00000100:00100000:0.0:1788845310.624540:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6444:x1875740189528448:12345-0@lo:502: Request processed in 1472us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845310.624550:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788845310.629576:0:6444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6444:1875740189528448:0@lo:502: 00000020:01000000:1.0:1788845310.629663:0:6444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845310.629676:0:6444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845310.629678:0:6444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788845310.629684:0:6444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788845310.629877:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788845310.629901:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845310.629912:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80030200/0xd8041b54d6df952e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845310.629922:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae80030200/0xd8041b54d6df952e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845310.811572:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845311.067620:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189528704:0@lo:400: 00000100:00100000:0.0:1788845311.067629:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189528576:0@lo:400: 00000100:00100000:0.0:1788845311.070311:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845311.073023:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845311.073088:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189528704 00000100:00100000:2.0:1788845311.073096:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189528704 00000100:00100000:2.0:1788845311.073213:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845311.073224:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189528704:12345-0@lo:400: 00000100:00100000:3.0:1788845311.074462:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189528576 00000100:00100000:3.0:1788845311.074470:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189528576 00000100:00100000:3.0:1788845311.074511:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788845311.074519:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3283:x1875740189528576:12345-0@lo:400: 00000100:00100000:3.0:1788845311.074591:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3283:x1875740189528576:12345-0@lo:400: Request processed in 73us (4287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845311.074603:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788845311.075445:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189528704:12345-0@lo:400: Request processed in 2222us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845311.075454:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788845311.075482:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92aebc8e0e00 x1875740189528704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845311.075497:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189528704:0@lo:400: 00000100:00100000:0.0:1788845311.075769:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189528576:0@lo:400: 00010000:00010000:1.0:1788845311.838546:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845312.869795:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845313.884665:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788845314.138135:0:6654:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788845314.138140:0:6654:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788845314.138513:0:6654:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92ae8fcc6800 00000020:01000004:3.0:1788845314.138535:0:6654:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788845314.138549:0:6654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788845314.138565:0:6654:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff92aeb4d4b370) 00000020:00000080:3.0:1788845314.138583:0:6654:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788845314.154786:0:6654:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788845314.155177:0:6654:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788845314.190796:0:6654:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788845314.197958:0:6654:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788845314.197995:0:6654:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788845314.198051:0:6654:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788845314.198082:0:6654:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788845314.198938:0:6654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788845314.198952:0:6654:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788845314.198975:0:6654:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd8041b54d6df9543 00000020:01000004:1.0:1788845314.198985:0:6654:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788845314.199011:0:6654:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.135@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788845314.199015:0:6654:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788845314.199021:0:6654:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788845314.199026:0:6654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788845314.199039:0:6654:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff92aeae5119b8) 00000020:00000080:1.0:1788845314.199050:0:6654:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1788845314.200572:0:6654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788845314.201073:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788845314.201080:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788845314.213794:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788845314.213825:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788845314.214697:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788845314.214708:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788845314.220782:0:6654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845314.221667:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788845314.221675:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788845314.226997:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788845314.227019:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788845314.301956:0:6654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845314.305038:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788845314.305053:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788845314.312104:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788845314.312131:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788845314.318962:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788845314.323589:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788845314.329391:0:6654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845314.329649:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788845314.329657:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788845314.331823:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788845314.331837:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788845314.415420:0:6654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845314.415695:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788845314.415702:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788845314.422195:0:6654:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788845314.422221:0:6654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788845314.423490:0:6654:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788845314.423519:0:6654:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788845314.423527:0:6654:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788845314.465222:0:6654:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788845314.465267:0:6654:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.135@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788845314.465272:0:6654:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788845314.465274:0:6654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788845314.465275:0:6654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845314.465276:0:6654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845314.465278:0:6654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845314.465279:0:6654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845314.465280:0:6654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788845314.465282:0:6654:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788845314.465283:0:6654:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788845314.465285:0:6654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845314.465286:0:6654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788845314.465290:0:6654:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788845314.465293:0:6654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788845314.465294:0:6654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788845314.465295:0:6654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845314.465296:0:6654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845314.465297:0:6654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845314.465298:0:6654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845314.465299:0:6654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788845314.465300:0:6654:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788845314.465301:0:6654:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788845314.465307:0:6654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845314.465308:0:6654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788845314.467388:0:6654:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788845314.467486:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189528832:0@lo:253: 00000100:00100000:2.0:1788845314.467577:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845314.467708:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c99000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845314.468696:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189528832 00000100:00100000:0.0:1788845314.468709:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189528832 00000100:00100000:0.0:1788845314.468819:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788845314.468832:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6654:x1875740189528832:12345-0@lo:253: 20000000:01000000:0.0:1788845314.468879:0:5812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788845314.468884:0:5812:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788845314.468891:0:5812:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788845314.468894:0:5812:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788845314.470039:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845314.470265:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788845314.470280:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788845314.470323:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788845314.470340:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788845314.470405:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788845314.470460:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788845314.475337:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788845314.475400:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.135@tcp 20000000:01000000:1.0:1788845314.475403:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.135@tcp (null) (null) (null) 00000040:00080000:1.0:1788845314.475443:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788845314.475452:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788845314.475506:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788845314.475528:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.135@tcp (null) (null) 00000040:00080000:1.0:1788845314.475564:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788845314.475575:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788845314.475603:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788845314.475657:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788845314.476476:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788845314.476500:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.135@tcp 20000000:01000000:1.0:1788845314.476503:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.135@tcp (null) (null) (null) 00000040:00080000:1.0:1788845314.476541:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788845314.476549:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788845314.476580:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788845314.476589:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.135@tcp (null) (null) 00000040:00080000:1.0:1788845314.476634:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788845314.476652:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788845314.476697:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788845314.476729:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788845314.476743:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788845314.476747:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788845314.476751:0:5812:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788845314.476764:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788845314.476767:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788845314.476800:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788845314.476803:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788845314.478917:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788845314.481178:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788845314.481233:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788845314.481325:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788845314.481341:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788845314.481344:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788845314.484528:0:6670:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788845314.484645:0:6670:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788845314.484717:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788845314.485165:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788845314.485232:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788845314.485272:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788845314.485286:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788845314.485289:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788845314.488880:0:6671:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788845314.489001:0:6671:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788845314.489054:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788845314.489723:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788845314.489768:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788845314.489831:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788845314.489850:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788845314.489852:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788845314.489864:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788845314.489886:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.489906:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae80030e00/0xd8041b54d6df946a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9463 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.489915:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae80031800/0xd8041b54d6df9486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df947f expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.489921:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aec2174200/0xd8041b54d6df94f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df94ef expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.489948:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.489994:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aec2174200/0xd8041b54d6df94f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df94ef expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.490008:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92aec2174200/0xd8041b54d6df94f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df94ef expref: 12 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.490024:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbcce300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189528960:0@lo:104: 00000100:00100000:2.0:1788845314.490336:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845314.490635:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae80031800/0xd8041b54d6df9486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df947f expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.490645:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae80031800/0xd8041b54d6df9486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df947f expref: 12 pid: 5810 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.490655:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189529088:0@lo:104: 00000100:00100000:2.0:1788845314.490692:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845314.490920:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae80030e00/0xd8041b54d6df946a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df9463 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.490928:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae80030e00/0xd8041b54d6df946a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df9463 expref: 12 pid: 5810 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.490936:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189529216:0@lo:104: 00000100:00100000:2.0:1788845314.490956:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845314.491003:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189528960 00000100:00100000:1.0:1788845314.491011:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189528960 00000100:00100000:1.0:1788845314.491056:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189529088 00000100:00100000:1.0:1788845314.491060:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189529088 00000100:00100000:1.0:1788845314.491087:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845314.491098:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbcced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:5812:x1875740189528960:12345-0@lo:104: 00010000:00010000:1.0:1788845314.491112:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df94ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491184:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788845314.491192:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbcced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:5812:x1875740189528960:12345-0@lo:104: Request processed in 96us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845314.491200:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845314.491218:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845314.491224:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:5812:x1875740189529088:12345-0@lo:104: 00010000:00010000:1.0:1788845314.491232:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae80030600/0xd8041b54d6df947f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491292:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788845314.491298:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:5812:x1875740189529088:12345-0@lo:104: Request processed in 74us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845314.491304:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788845314.491325:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788845314.491331:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df94ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491338:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52e00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:1.0:1788845314.491343:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df94ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491351:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df94ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845314.491358:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df94ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845314.491394:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845314.491427:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df94ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491433:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845314.491452:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df94ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491458:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df94ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df94f6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491480:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845314.491483:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae80030600/0xd8041b54d6df947f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491489:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:1.0:1788845314.491491:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae80030600/0xd8041b54d6df947f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491498:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae80030600/0xd8041b54d6df947f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845314.491515:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae80030600/0xd8041b54d6df947f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845314.491520:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845314.491534:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae80030600/0xd8041b54d6df947f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491543:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845314.491549:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae80030600/0xd8041b54d6df947f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491555:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae80030600/0xd8041b54d6df947f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9486 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.491565:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845314.491567:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845314.491569:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845314.491593:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189529472:0@lo:103: 00000100:00100000:2.0:1788845314.491598:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c99780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845314.491630:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845314.491652:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845314.491657:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189529344:0@lo:103: 00000100:00100000:1.0:1788845314.491675:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845314.491707:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbcce300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189528960:0@lo:104: 00000100:00100000:1.0:1788845314.491714:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189529472 00000100:00100000:1.0:1788845314.491720:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189529472 00000100:00100000:2.0:1788845314.491736:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189529088:0@lo:104: 00010000:00010000:1.0:1788845314.491742:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae80031800/0xd8041b54d6df9486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df947f expref: 13 pid: 5810 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845314.491768:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189529344 00000100:00100000:1.0:1788845314.491771:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189529344 00010000:00010000:1.0:1788845314.491782:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aec2174200/0xd8041b54d6df94f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df94ef expref: 14 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.491787:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845314.491801:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:3286:x1875740189529472:12345-0@lo:103: 00000100:00100000:1.0:1788845314.491802:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788845314.491813:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788845314.491888:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189529216 00000100:00100000:3.0:1788845314.491894:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189529216 00000100:00100000:3.0:1788845314.491918:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845314.491926:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbcce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:5812:x1875740189529216:12345-0@lo:104: 00010000:00010000:3.0:1788845314.491936:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df9463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.491980:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845314.491986:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbcce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:5812:x1875740189529216:12345-0@lo:104: Request processed in 61us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845314.491998:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845314.492038:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788845314.492046:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845314.492054:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:3286:x1875740189529344:12345-0@lo:103: 00010000:00010000:3.0:1788845314.492064:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845314.492070:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aec2174200/0xd8041b54d6df94f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df94ef expref: 14 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492071:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845314.492081:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df9463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.492087:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aec2174200/0xd8041b54d6df94f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df94ef expref: 14 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492095:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174400 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:0.0:1788845314.492101:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df9463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.492108:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aec2174200/0xd8041b54d6df94f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df94ef expref: 14 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492110:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df9463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845314.492126:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df9463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845314.492131:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845314.492132:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845314.492168:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df9463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492174:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788845314.492190:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:3286:x1875740189529344:12345-0@lo:103: Request processed in 136us (512us total) trans 0 rc 0/0 00010000:00010000:0.0:1788845314.492191:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df9463 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845314.492203:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788845314.492205:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df9463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df946a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492221:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845314.492229:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845314.492231:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845314.492235:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189529344:0@lo:103: 00000100:00100000:0.0:1788845314.492246:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189529600:0@lo:103: 00010000:00010000:3.0:1788845314.492258:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845314.492292:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845314.492300:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845314.492309:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae80031800/0xd8041b54d6df9486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df947f expref: 12 pid: 5810 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.492322:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae80031800/0xd8041b54d6df9486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df947f expref: 12 pid: 5810 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.492336:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae80031800/0xd8041b54d6df9486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df947f expref: 12 pid: 5810 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845314.492339:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788845314.492348:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189529600 00000100:00100000:0.0:1788845314.492351:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189529600 00010000:00010000:2.0:1788845314.492358:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845314.492383:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae80030e00/0xd8041b54d6df946a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9463 expref: 12 pid: 5810 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845314.492398:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788845314.492406:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845314.492411:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3283:x1875740189529600:12345-0@lo:103: 00010000:00010000:0.0:1788845314.492418:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845314.492421:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae80030e00/0xd8041b54d6df946a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9463 expref: 12 pid: 5810 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492430:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae80030e00/0xd8041b54d6df946a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df9463 expref: 12 pid: 5810 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492443:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492451:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492465:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492473:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492489:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492495:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492500:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845314.492520:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492527:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.492531:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3286:x1875740189529472:12345-0@lo:103: Request processed in 732us (899us total) trans 0 rc 0/0 00010000:00010000:0.0:1788845314.492541:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.492542:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788845314.492555:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845314.492591:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:3283:x1875740189529600:12345-0@lo:103: Request processed in 179us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845314.492597:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788845314.492662:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae80030e00/0xd8041b54d6df946a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df9463 expref: 10 pid: 5810 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845314.492672:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189529216:0@lo:104: 00010000:00010000:0.0:1788845314.492705:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.492712:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189529600:0@lo:103: 00010000:00010000:0.0:1788845314.492716:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492734:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.492741:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81481200/0xd8041b54d6df9551 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845314.492744:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189529472:0@lo:103: 20000000:01000000:0.0:1788845314.492766:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788845314.544847:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+9:6654:x1875740189528832:12345-0@lo:253: Request processed in 76005us (77257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845314.544864:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788845314.545336:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189528832:0@lo:253: 10000000:01000000:3.0:1788845314.545358:0:6654:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788845314.545396:0:6654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788845314.545398:0:6654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788845314.545399:0:6654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845314.545400:0:6654:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788845314.545419:0:6654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845314.545421:0:6654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845314.545422:0:6654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845314.545424:0:6654:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788845314.545426:0:6654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845314.545427:0:6654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788845314.545451:0:6654:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92ae8fcc6800 from lustre-OST0000 10000000:01000000:3.0:1788845314.545498:0:6654:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788845314.545502:0:6654:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788845314.545510:0:6654:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92ae8ff0cd28 local copy 10000000:01000000:3.0:1788845314.545515:0:6654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788845314.545562:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.545575:0:6654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.545586:0:6654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845314.545609:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189529728:0@lo:101: 00000100:00100000:3.0:1788845314.545654:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845314.545803:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc319240 going to sleep for 11 seconds 00000100:00100000:2.0:1788845314.549734:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189529728 00000100:00100000:2.0:1788845314.549754:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189529728 00000100:00100000:0.0:1788845314.549908:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788845314.549921:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+9:6654:x1875740189529728:12345-0@lo:101: 00010000:00010000:0.0:1788845314.549943:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845314.549967:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae80030e00/0xd8041b54d6df955f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9558 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.550001:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae80030e00/0xd8041b54d6df955f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9558 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.550014:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae80030e00/0xd8041b54d6df955f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9558 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.550024:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845314.550119:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:6654:x1875740189529728:12345-0@lo:101: Request processed in 200us (4463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845314.550126:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788845314.550424:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189529728:0@lo:101: 00010000:00010000:2.0:1788845314.550446:0:6654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.550456:0:6654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.550618:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189529856:0@lo:501: 00000100:00100000:2.0:1788845314.550659:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845314.550778:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea797c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845314.551293:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189529856 00000100:00100000:3.0:1788845314.551301:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189529856 00000100:00100000:3.0:1788845314.551338:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788845314.551347:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:6654:x1875740189529856:12345-0@lo:501: 00000100:00100000:3.0:1788845314.551646:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:6654:x1875740189529856:12345-0@lo:501: Request processed in 300us (985us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845314.551654:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788845314.552611:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189529856:0@lo:501: 10000000:01000000:2.0:1788845314.552637:0:6654:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788845314.552704:0:6654:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788845314.552712:0:6654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.552723:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.552730:0:6654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.552757:0:6654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788845314.552781:0:6654:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92ae8fcc6800 10000000:01000000:2.0:1788845314.552786:0:6654:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788845314.552791:0:6654:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff92ae8ff0cd28 10000000:01000000:2.0:1788845314.552793:0:6654:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788845314.552797:0:6654:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff92ae8ff0cd28 from 1 10000000:01000000:2.0:1788845314.552799:0:6654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788845314.552832:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480800/0xd8041b54d6df9566 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.552839:0:6654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae81480800/0xd8041b54d6df9566 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.552863:0:6654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae81480800/0xd8041b54d6df9566 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.552881:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189529984:0@lo:101: 00000100:00100000:2.0:1788845314.552926:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845314.553015:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189529984 00000100:00100000:3.0:1788845314.553021:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189529984 00000100:00100000:3.0:1788845314.553069:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788845314.553077:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:6654:x1875740189529984:12345-0@lo:101: 00010000:00010000:3.0:1788845314.553090:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845314.553104:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aec2175000/0xd8041b54d6df956d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9566 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.553128:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aec2175000/0xd8041b54d6df956d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9566 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.553155:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aec2175000/0xd8041b54d6df956d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9566 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.553166:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aec2175000, rc 0) 00000100:00100000:3.0:1788845314.553199:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:6654:x1875740189529984:12345-0@lo:101: Request processed in 123us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845314.553206:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1788845314.553470:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845314.553479:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.553486:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174200 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:0.0:1788845314.553499:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.553509:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845314.553515:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845314.553520:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845314.553544:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.553550:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845314.553582:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.553589:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aec2174200/0xd8041b54d6df9558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd8041b54d6df955f expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.553607:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845314.553609:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845314.553611:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845314.556079:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845314.556114:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189530112:0@lo:103: 00000100:00100000:0.0:1788845314.556204:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845314.556910:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea797c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845314.556947:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189529984:0@lo:101: 00010000:00010000:2.0:1788845314.556972:0:6654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae81480800/0xd8041b54d6df9566 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df956d expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.556987:0:6654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae81480800/0xd8041b54d6df9566 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df956d expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845314.557012:0:6654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788845314.557029:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480800/0xd8041b54d6df9566 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df956d expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.557037:0:6654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae81480800/0xd8041b54d6df9566 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df956d expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845314.557046:0:6654:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788845314.557052:0:6654:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788845314.557059:0:6654:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788845314.557062:0:6654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788845314.557097:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.557105:0:6654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.557134:0:6654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.557166:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530240:0@lo:101: 00000100:00100000:2.0:1788845314.557201:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845314.557224:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea797c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845314.557250:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189530112 00000100:00100000:2.0:1788845314.557270:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189530112 00000100:00100000:2.0:1788845314.557328:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845314.557338:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:3283:x1875740189530112:12345-0@lo:103: 00010000:00010000:2.0:1788845314.557383:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845314.557402:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae80030e00/0xd8041b54d6df955f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df9558 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.557422:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845314.557456:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:3283:x1875740189530112:12345-0@lo:103: Request processed in 119us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845314.557463:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845314.558675:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189530240 00000100:00100000:2.0:1788845314.558703:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189530240 00000100:00100000:2.0:1788845314.558762:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788845314.558771:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:6654:x1875740189530240:12345-0@lo:101: 00010000:00010000:2.0:1788845314.558788:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845314.558807:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae81480e00/0xd8041b54d6df957b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9574 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.558834:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81480e00/0xd8041b54d6df957b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9574 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.558861:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae81480e00/0xd8041b54d6df957b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9574 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.558870:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae81480e00, rc 0) 00000100:00100000:2.0:1788845314.558929:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:6654:x1875740189530240:12345-0@lo:101: Request processed in 160us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845314.558936:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788845314.558997:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530240:0@lo:101: 00010000:00010000:2.0:1788845314.559014:0:6654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845314.559023:0:6654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.559321:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530368:0@lo:501: 00000100:00100000:2.0:1788845314.559402:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845314.559432:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea797c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845314.559542:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189530368 00000100:00100000:3.0:1788845314.559547:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189530368 00000100:00100000:3.0:1788845314.559579:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788845314.559586:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:6654:x1875740189530368:12345-0@lo:501: 00000100:00100000:3.0:1788845314.559854:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:6654:x1875740189530368:12345-0@lo:501: Request processed in 268us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845314.559861:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788845314.563101:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530368:0@lo:501: 00000100:00100000:2.0:1788845314.563506:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530496:0@lo:503: 00000100:00100000:2.0:1788845314.563606:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845314.563661:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea797c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845314.563741:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189530496 00000100:00100000:3.0:1788845314.563750:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189530496 00000100:00100000:3.0:1788845314.563816:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845314.563826:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:6654:x1875740189530496:12345-0@lo:503: 00000100:00100000:3.0:1788845314.564052:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:6654:x1875740189530496:12345-0@lo:503: Request processed in 226us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845314.564069:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788845314.564302:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530496:0@lo:503: 00000040:00080000:2.0:1788845314.564664:0:6654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788845314.564758:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530624:0@lo:502: 00000100:00100000:2.0:1788845314.564804:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845314.564849:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae90785a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845314.564987:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189530624 00000100:00100000:3.0:1788845314.564992:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189530624 00000100:00100000:3.0:1788845314.565031:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788845314.565040:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:6654:x1875740189530624:12345-0@lo:502: 00000100:00100000:3.0:1788845314.565216:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:6654:x1875740189530624:12345-0@lo:502: Request processed in 177us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845314.565223:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788845314.565602:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530624:0@lo:502: 00000040:00080000:2.0:1788845314.565890:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788845314.565947:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788845314.565984:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788845314.566032:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788845314.566069:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788845314.566123:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788845314.566653:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189530112:0@lo:103: 00000100:00100000:3.0:1788845314.569590:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530752:0@lo:502: 00000100:00100000:3.0:1788845314.569714:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845314.569823:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc319300 going to sleep for 11 seconds 00000100:00100000:2.0:1788845314.570686:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189530752 00000100:00100000:2.0:1788845314.570698:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189530752 00000100:00100000:2.0:1788845314.570759:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788845314.570768:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:6654:x1875740189530752:12345-0@lo:502: 00000100:00100000:2.0:1788845314.571105:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:6654:x1875740189530752:12345-0@lo:502: Request processed in 336us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845314.571113:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788845314.571747:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530752:0@lo:502: 00000040:00080000:3.0:1788845314.572028:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788845314.572046:0:6654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788845314.572959:0:6673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788845314.572969:0:6673:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788845314.572975:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845314.572978:0:6673:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788845314.572984:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788845314.573008:0:6673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff92aeb7724d28) 00000020:00000080:1.0:1788845314.573033:0:6673:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788845314.573041:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788845314.573115:0:6673:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92ae8fcc6800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788845314.573124:0:6673:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788845314.573131:0:6673:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd8041b54d6df9589 00010000:00010000:0.0:1788845314.579011:0:6673:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788845314.579778:0:6673:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788845314.582792:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788845314.583128:0:6673:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788845314.595024:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788845314.596031:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788845314.603651:0:6673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788845314.603668:0:6673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845314.603689:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845314.603693:0:6673:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788845314.603701:0:6673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845314.603706:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845314.603708:0:6673:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788845314.603711:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788845314.603713:0:6673:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788845314.603781:0:6673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845314.603785:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845314.603786:0:6673:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788845314.603790:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788845314.603977:0:6654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788845314.604007:0:6654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788845314.604032:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.604059:0:6654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845314.604068:0:6654:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ae8fcc6800 from 1 10000000:01000000:1.0:1788845314.604071:0:6654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845314.604111:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.604120:0:6654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.604133:0:6654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845314.604175:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530880:0@lo:101: 00000100:00100000:1.0:1788845314.604251:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845314.604311:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c99000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845314.604351:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189530880 00000100:00100000:1.0:1788845314.604389:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189530880 00000100:00100000:1.0:1788845314.604438:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788845314.604448:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:6654:x1875740189530880:12345-0@lo:101: 00010000:00010000:1.0:1788845314.604465:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845314.604480:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae89a52400/0xd8041b54d6df9597 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9590 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.604507:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae89a52400/0xd8041b54d6df9597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9590 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.604519:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae89a52400/0xd8041b54d6df9597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9590 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.604538:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a52400, rc 0) 00000100:00100000:1.0:1788845314.604581:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6654:x1875740189530880:12345-0@lo:101: Request processed in 134us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845314.604588:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788845314.604641:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189530880:0@lo:101: 00010000:00010000:1.0:1788845314.604656:0:6654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845314.604666:0:6654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845314.604771:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531008:0@lo:501: 00000100:00100000:1.0:1788845314.604797:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845314.604819:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c99000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845314.604834:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189531008 00000100:00100000:1.0:1788845314.604837:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189531008 00000100:00100000:1.0:1788845314.604879:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788845314.604886:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6654:x1875740189531008:12345-0@lo:501: 00000100:00100000:1.0:1788845314.605125:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6654:x1875740189531008:12345-0@lo:501: Request processed in 238us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845314.605132:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788845314.605166:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531008:0@lo:501: 00000100:00100000:1.0:1788845314.605193:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531136:0@lo:503: 00000100:00100000:1.0:1788845314.605230:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845314.605244:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c99000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845314.605263:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189531136 00000100:00100000:1.0:1788845314.605267:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189531136 00000100:00100000:1.0:1788845314.605284:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788845314.605289:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6654:x1875740189531136:12345-0@lo:503: 00000100:00100000:1.0:1788845314.605544:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6654:x1875740189531136:12345-0@lo:503: Request processed in 254us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845314.605551:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788845314.605591:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531136:0@lo:503: 00000040:00080000:1.0:1788845314.605897:0:6654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788845314.605955:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531264:0@lo:502: 00000100:00100000:1.0:1788845314.605987:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845314.606002:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c99000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845314.606015:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189531264 00000100:00100000:1.0:1788845314.606019:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189531264 00000100:00100000:1.0:1788845314.606035:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788845314.606041:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6654:x1875740189531264:12345-0@lo:502: 00000100:00100000:1.0:1788845314.606179:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6654:x1875740189531264:12345-0@lo:502: Request processed in 136us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845314.606186:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788845314.606224:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531264:0@lo:502: 00000040:00080000:1.0:1788845314.606467:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788845314.606516:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788845314.606540:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531392:0@lo:502: 00000100:00100000:1.0:1788845314.606576:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845314.606593:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c99000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845314.606609:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189531392 00000100:00100000:1.0:1788845314.606613:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189531392 00000100:00100000:1.0:1788845314.606639:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788845314.606646:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6654:x1875740189531392:12345-0@lo:502: 00000100:00100000:1.0:1788845314.606762:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6654:x1875740189531392:12345-0@lo:502: Request processed in 115us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845314.606768:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788845314.606802:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531392:0@lo:502: 00000040:00080000:1.0:1788845314.606866:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788845314.606875:0:6654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788845314.609975:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845314.609994:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845314.609997:0:6677:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788845314.610005:0:6677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ae8fcc6800 00000020:00000080:2.0:1788845314.610008:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788845314.610030:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845314.610033:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845314.610035:0:6677:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788845314.610037:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788845314.610238:0:6654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788845314.610273:0:6654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845314.610295:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.610308:0:6654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845314.610385:0:6654:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788845314.610388:0:6654:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92ae8fcc6800 10000000:01000000:3.0:1788845314.610391:0:6654:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92ae8fcc6800 10000000:01000000:3.0:1788845314.610396:0:6654:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845314.610403:0:6654:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ae8fcc6800 from 1 10000000:01000000:3.0:1788845314.610406:0:6654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788845314.610449:0:6654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.610464:0:6654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.610478:0:6654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845314.610502:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531520:0@lo:101: 00000100:00100000:3.0:1788845314.610573:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845314.610671:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc3199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845314.610707:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189531520 00000100:00100000:3.0:1788845314.610715:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189531520 00000100:00100000:3.0:1788845314.610761:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788845314.610771:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:6654:x1875740189531520:12345-0@lo:101: 00010000:00010000:3.0:1788845314.610786:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845314.610799:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aec2175c00/0xd8041b54d6df95a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df959e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.610827:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aec2175c00/0xd8041b54d6df95a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df959e expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.610839:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aec2175c00/0xd8041b54d6df95a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df959e expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.610847:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aec2175c00, rc 0) 00000100:00100000:3.0:1788845314.610890:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6654:x1875740189531520:12345-0@lo:101: Request processed in 121us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845314.610896:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788845314.610949:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531520:0@lo:101: 00010000:00010000:3.0:1788845314.610968:0:6654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.610978:0:6654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845314.611063:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531648:0@lo:501: 00000100:00100000:3.0:1788845314.611087:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845314.611103:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc3199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845314.612003:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189531648 00000100:00100000:1.0:1788845314.612014:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189531648 00000100:00100000:1.0:1788845314.612107:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788845314.612118:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6654:x1875740189531648:12345-0@lo:501: 00000100:00100000:1.0:1788845314.612760:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6654:x1875740189531648:12345-0@lo:501: Request processed in 642us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845314.612770:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788845314.612951:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531648:0@lo:501: 00000100:00100000:3.0:1788845314.613000:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531776:0@lo:503: 00000100:00100000:3.0:1788845314.613042:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845314.613303:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc3199c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845314.615729:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189531776 00000100:00100000:0.0:1788845314.615742:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189531776 00000100:00100000:0.0:1788845314.615795:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788845314.615806:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6654:x1875740189531776:12345-0@lo:503: 00000100:00100000:0.0:1788845314.616067:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6654:x1875740189531776:12345-0@lo:503: Request processed in 262us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845314.616074:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788845314.618104:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531776:0@lo:503: 00000040:00080000:3.0:1788845314.618907:0:6654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788845314.619014:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531904:0@lo:502: 00000100:00100000:3.0:1788845314.619092:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845314.619449:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc3199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845314.619707:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189531904 00000100:00100000:1.0:1788845314.619717:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189531904 00000100:00100000:1.0:1788845314.619803:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788845314.619813:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6654:x1875740189531904:12345-0@lo:502: 00000100:00100000:1.0:1788845314.620070:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6654:x1875740189531904:12345-0@lo:502: Request processed in 258us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845314.620078:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788845314.620283:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189531904:0@lo:502: 00000040:00080000:3.0:1788845314.620614:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788845314.620671:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788845314.620721:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788845314.620780:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788845314.620815:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788845314.620858:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788845314.620890:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788845314.620920:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788845314.620976:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788845314.621008:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788845314.621039:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788845314.621081:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788845314.621118:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788845314.621458:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788845314.621516:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788845314.621551:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788845314.621583:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788845314.621626:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788845314.621660:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788845314.621724:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788845314.621778:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788845314.621815:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788845314.621850:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788845314.621898:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788845314.621935:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788845314.621969:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788845314.622017:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788845314.622054:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788845314.622105:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189532032:0@lo:502: 00000100:00100000:3.0:1788845314.622599:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845314.622734:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc3199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845314.622800:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189532032 00000100:00100000:1.0:1788845314.622808:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189532032 00000100:00100000:1.0:1788845314.622868:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788845314.622877:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6654:x1875740189532032:12345-0@lo:502: 00000100:00100000:1.0:1788845314.623112:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6654:x1875740189532032:12345-0@lo:502: Request processed in 235us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845314.623126:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788845314.623251:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189532032:0@lo:502: 00000040:00080000:0.0:1788845314.623389:0:6654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788845314.623404:0:6654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788845314.624123:0:6678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788845314.624148:0:6678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92aeb77219b8) 00000020:00000080:1.0:1788845314.624172:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788845314.624245:0:6678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92ae8fcc6800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788845314.624249:0:6678:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92ae8fcc6800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788845314.624252:0:6678:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ae8fcc6800 3 00010000:00080000:1.0:1788845314.624283:0:6678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92aead935800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.135@tcp at head 00010000:00010000:1.0:1788845314.628169:0:6678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788845314.628521:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788845314.628562:0:6678:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788845314.628575:0:6678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd8041b54d6df95b3 00000100:00080000:1.0:1788845314.628587:0:6678:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788845314.628593:0:6678:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92aead935800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:1.0:1788845314.628637:0:6678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aeae50b480 x1875740189532160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788845314.628662:0:6678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788845314.628753:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875740189532160:0@lo:38: 00000100:00100000:2.0:1788845314.628832:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845314.629136:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189532288:0@lo:400: 00000100:00100000:1.0:1788845314.629182:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845314.631272:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189532160 00000100:00100000:2.0:1788845314.631288:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189532160 00000100:00100000:2.0:1788845314.631449:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189532288 00000100:00100000:2.0:1788845314.631454:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189532288 00000100:00100000:0.0:1788845314.634597:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845314.634618:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189532288:12345-0@lo:400: 00000100:00100000:0.0:1788845314.634755:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189532288:12345-0@lo:400: Request processed in 145us (5571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845314.634772:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845314.634804:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788845314.634809:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875740189532160:12345-0@lo:38: 00010000:00080000:0.0:1788845314.634836:0:5817:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:0.0:1788845314.634874:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd8041b54d6df95ba 00000004:00100000:0.0:1788845314.634891:0:5817:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788845314.634925:0:5817:0:(import.c:65:import_set_state_nolock()) ffff92ae90d34800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845314.634977:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875740189532160:12345-0@lo:38: Request processed in 165us (6144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845314.634984:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788845314.635211:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92aeae50b480 x1875740189532160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845314.635224:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788845314.635234:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788845314.635242:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788845314.635248:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788845314.635250:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92aead935800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788845314.635256:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875740189532160:0@lo:38: 00010000:00080000:1.0:1788845314.635710:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92aebbccd500 x1875740189532288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845314.635722:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189532288:0@lo:400: 00000040:00080000:1.0:1788845314.635961:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788845314.636119:0:6654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788845314.636161:0:6654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845314.636185:0:6654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.636196:0:6654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788845314.636249:0:6654:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788845314.636251:0:6654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788845314.636253:0:6654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845314.636254:0:6654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845314.636255:0:6654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845314.636257:0:6654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845314.636258:0:6654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845314.636260:0:6654:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845314.636261:0:6654:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845314.636264:0:6654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845314.636265:0:6654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845314.636269:0:6654:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788845314.636277:0:6654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788845314.636278:0:6654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788845314.636279:0:6654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845314.636280:0:6654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845314.636281:0:6654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845314.636282:0:6654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845314.636283:0:6654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845314.636284:0:6654:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845314.636285:0:6654:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845314.636286:0:6654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845314.636287:0:6654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845314.636312:0:6654:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788845314.636330:0:6654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189532416:0@lo:253: 00000100:00100000:0.0:1788845314.636422:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845314.636460:0:6654:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae833e4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845314.636654:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189532416 00000100:00100000:1.0:1788845314.636662:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189532416 00000100:00100000:1.0:1788845314.636743:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788845314.636753:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6654:x1875740189532416:12345-0@lo:253: 20000000:01000000:1.0:1788845314.636791:0:5812:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788845314.636808:0:5812:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788845314.665785:0:5812:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788845314.665842:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788845314.670512:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6654:x1875740189532416:12345-0@lo:253: Request processed in 33746us (34076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845314.670531:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788845314.670618:0:6654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6654:1875740189532416:0@lo:253: 10000000:01000000:1.0:1788845314.670636:0:6654:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788845314.670639:0:6654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788845314.670641:0:6654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788845314.670642:0:6654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845314.670643:0:6654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845314.670645:0:6654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845314.670646:0:6654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845314.670647:0:6654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788845314.670649:0:6654:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788845314.670650:0:6654:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788845314.670652:0:6654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845314.670654:0:6654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788845314.670671:0:6654:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788845314.671656:0:5833:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788845314.671666:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788845314.671705:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.671727:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae81481800/0xd8041b54d6df9519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9512 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.671736:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.671784:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae81481800/0xd8041b54d6df9519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df9512 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.671800:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae81481800/0xd8041b54d6df9519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df9512 expref: 12 pid: 5812 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845314.671816:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875740189532544:0@lo:104: 00000100:00100000:0.0:1788845314.671875:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845314.671985:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fd8b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788845314.675280:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189532544 00000100:00100000:3.0:1788845314.675295:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189532544 00000100:00100000:0.0:1788845314.675588:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845314.675603:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:5833:x1875740189532544:12345-0@lo:104: 00010000:00010000:0.0:1788845314.675626:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aec2174600/0xd8041b54d6df9512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845314.675750:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845314.675758:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:5833:x1875740189532544:12345-0@lo:104: Request processed in 159us (3884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845314.675766:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788845314.675865:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875740189532544:0@lo:104: 00010000:00010000:2.0:1788845314.675895:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.675994:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845314.676002:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aec2174600/0xd8041b54d6df9512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.676010:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174600 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:3.0:1788845314.676015:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174600/0xd8041b54d6df9512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.676033:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aec2174600/0xd8041b54d6df9512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845314.676040:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174600/0xd8041b54d6df9512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845314.676047:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845314.676089:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aec2174600/0xd8041b54d6df9512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.676096:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788845314.676162:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189532672:0@lo:103: 00000100:00100000:2.0:1788845314.676213:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:1.0:1788845314.676967:0:6654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00010000:00010000:3.0:1788845314.677259:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aec2174600/0xd8041b54d6df9512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677271:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aec2174600/0xd8041b54d6df9512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9519 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677290:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845314.677292:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845314.677294:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845314.677529:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189532672 00000100:00100000:3.0:1788845314.677538:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189532672 00010000:00010000:3.0:1788845314.677568:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae81481800/0xd8041b54d6df9519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9512 expref: 13 pid: 5812 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845314.677607:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845314.677616:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:3286:x1875740189532672:12345-0@lo:103: 00010000:00010000:3.0:1788845314.677630:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845314.677637:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae81481800/0xd8041b54d6df9519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9512 expref: 13 pid: 5812 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677657:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae81481800/0xd8041b54d6df9519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df9512 expref: 13 pid: 5812 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677675:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81481800/0xd8041b54d6df9519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df9512 expref: 13 pid: 5812 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677703:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677711:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788845314.677729:0:5804:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006063946s 00010000:00010000:3.0:1788845314.677735:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677742:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677748:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677754:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677760:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845314.677765:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677773:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677796:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.677806:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00080000:10000000:1.0:1788845314.677946:0:6654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788845314.678356:0:6654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845314.678565:0:6654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788845314.678795:0:6654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845314.679018:0:6654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000100:00100000:3.0:1788845314.679742:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3286:x1875740189532672:12345-0@lo:103: Request processed in 2122us (3524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845314.679755:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788845314.679832:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.679844:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845314.679851:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae80031600/0xd8041b54d6df95c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845314.680014:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189532672:0@lo:103: 00000001:00000004:0.0:1788845314.681074:0:6654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788845314.915033:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788845315.026182:0:6654:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788845315.026190:0:6654:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788845315.026225:0:6654:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788845315.026287:0:6654:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788845315.026305:0:6654:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788845315.026331:0:6654:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788845315.931650:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845316.955512:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788845317.915791:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788845317.915801:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ae90de3800 from 21 10000000:01000000:1.0:1788845317.915808:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788845317.915875:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.915959:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.915982:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845317.916011:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189532800:0@lo:101: 00000100:00100000:1.0:1788845317.916095:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845317.916172:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845317.916183:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189532800 00000100:00100000:2.0:1788845317.916192:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189532800 00000100:00100000:2.0:1788845317.916250:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788845317.916261:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189532800:12345-0@lo:101: 00010000:00010000:2.0:1788845317.916277:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845317.916305:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae81481200/0xd8041b54d6df95cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df95c8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845317.916333:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81481200/0xd8041b54d6df95cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df95c8 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845317.916359:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae81481200/0xd8041b54d6df95cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df95c8 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845317.916387:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae81481200, rc 0) 00000100:00100000:2.0:1788845317.916441:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189532800:12345-0@lo:101: Request processed in 181us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845317.916460:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788845317.917063:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189532800:0@lo:101: 00010000:00010000:1.0:1788845317.917081:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.917092:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845317.917157:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189532928:0@lo:501: 00000100:00100000:1.0:1788845317.917554:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845317.917592:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845317.917646:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189532928 00000100:00100000:2.0:1788845317.917652:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189532928 00000100:00100000:2.0:1788845317.917703:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788845317.917711:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189532928:12345-0@lo:501: 00000100:00100000:2.0:1788845317.918009:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189532928:12345-0@lo:501: Request processed in 298us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845317.918017:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788845317.918397:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189532928:0@lo:501: 00000100:00100000:1.0:1788845317.918431:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533056:0@lo:503: 00000100:00100000:1.0:1788845317.920228:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845317.920262:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845317.920675:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189533056 00000100:00100000:3.0:1788845317.920683:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189533056 00000100:00100000:3.0:1788845317.920777:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788845317.920787:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189533056:12345-0@lo:503: 00000100:00100000:3.0:1788845317.921082:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189533056:12345-0@lo:503: Request processed in 294us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845317.921099:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788845317.924695:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533056:0@lo:503: 00000100:00100000:1.0:1788845317.927057:0:6802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6802:1875740189533184:0@lo:502: 00000100:00100000:1.0:1788845317.927159:0:6802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845317.927214:0:6802:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845317.927276:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189533184 00000100:00100000:2.0:1788845317.927285:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189533184 00000100:00100000:2.0:1788845317.927349:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788845317.927359:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6802:x1875740189533184:12345-0@lo:502: 00000100:00100000:2.0:1788845317.927714:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6802:x1875740189533184:12345-0@lo:502: Request processed in 356us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845317.927723:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788845317.927990:0:6802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6802:1875740189533184:0@lo:502: 00000100:00100000:1.0:1788845317.928053:0:6802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6802:1875740189533312:0@lo:502: 00000100:00100000:1.0:1788845317.928099:0:6802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845317.928127:0:6802:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845317.928279:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189533312 00000100:00100000:2.0:1788845317.928284:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189533312 00000100:00100000:2.0:1788845317.928325:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788845317.928332:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6802:x1875740189533312:12345-0@lo:502: 00000100:00100000:2.0:1788845317.928503:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:6802:x1875740189533312:12345-0@lo:502: Request processed in 171us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845317.928515:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788845317.928704:0:6802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6802:1875740189533312:0@lo:502: 00000040:00080000:1.0:1788845317.928725:0:6802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788845317.928952:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788845317.928973:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788845317.928984:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845317.928997:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845317.929007:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788845317.929010:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ae90de3800 from 4 10000000:01000000:2.0:1788845317.929013:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788845317.929041:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845317.929050:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845317.929071:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845317.929086:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533440:0@lo:101: 00000100:00100000:2.0:1788845317.929211:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845317.929242:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fd956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845317.929285:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189533440 00000100:00100000:1.0:1788845317.929299:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189533440 00000100:00100000:1.0:1788845317.929323:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788845317.929329:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189533440:12345-0@lo:101: 00010000:00010000:1.0:1788845317.929339:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845317.929353:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae89a53a00/0xd8041b54d6df95dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df95d6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.929393:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae89a53a00/0xd8041b54d6df95dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df95d6 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.929406:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae89a53a00/0xd8041b54d6df95dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df95d6 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.929416:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a53a00, rc 0) 00000100:00100000:1.0:1788845317.929693:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189533440:12345-0@lo:101: Request processed in 363us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845317.929700:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788845317.929738:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533440:0@lo:101: 00010000:00010000:1.0:1788845317.929750:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.929770:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845317.929814:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533568:0@lo:256: 00000100:00100000:1.0:1788845317.929845:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845317.929865:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845317.929877:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189533568 00000100:00100000:1.0:1788845317.929880:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189533568 00000100:00100000:1.0:1788845317.929897:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788845317.929903:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189533568:12345-0@lo:256: 20000000:01000000:1.0:1788845317.929918:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788845317.929936:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788845317.929939:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788845317.930010:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189533568:12345-0@lo:256: Request processed in 106us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845317.930016:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788845317.930043:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533568:0@lo:256: 10000000:01000000:1.0:1788845317.930105:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788845317.930111:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.930120:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845317.930127:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788845317.930129:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788845317.930132:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788845317.930152:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.930159:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.930166:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845317.930178:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533696:0@lo:101: 00000100:00100000:1.0:1788845317.930203:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845317.930217:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845317.930228:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189533696 00000100:00100000:1.0:1788845317.930231:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189533696 00000100:00100000:1.0:1788845317.930247:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788845317.930253:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189533696:12345-0@lo:101: 00010000:00010000:1.0:1788845317.930260:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845317.930268:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df95eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df95e4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.930282:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df95eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df95e4 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.930290:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df95eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df95e4 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.930430:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a53c00, rc 0) 00000100:00100000:1.0:1788845317.930566:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189533696:12345-0@lo:101: Request processed in 312us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845317.930572:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788845317.930617:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533696:0@lo:101: 00010000:00010000:1.0:1788845317.930627:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845317.930636:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845317.930690:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533824:0@lo:501: 00000100:00100000:1.0:1788845317.930715:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845317.930733:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845317.930744:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189533824 00000100:00100000:1.0:1788845317.930747:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189533824 00000100:00100000:1.0:1788845317.930764:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788845317.930770:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189533824:12345-0@lo:501: 00000100:00100000:1.0:1788845317.931018:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189533824:12345-0@lo:501: Request processed in 247us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845317.931024:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788845317.931053:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533824:0@lo:501: 00000100:00100000:1.0:1788845317.931593:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533952:0@lo:503: 00000100:00100000:1.0:1788845317.931635:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845317.931681:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fd8b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845317.931770:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189533952 00000100:00100000:2.0:1788845317.931775:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189533952 00000100:00100000:2.0:1788845317.931813:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788845317.931820:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189533952:12345-0@lo:503: 00000100:00100000:2.0:1788845317.932044:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189533952:12345-0@lo:503: Request processed in 225us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845317.932058:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788845317.932405:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189533952:0@lo:503: 00000100:00100000:3.0:1788845317.942460:0:6803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6803:1875740189534080:0@lo:502: 00000100:00100000:3.0:1788845317.942557:0:6803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845317.942615:0:6803:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8647a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788845317.942891:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189534080 00000100:00100000:1.0:1788845317.942900:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189534080 00000100:00100000:1.0:1788845317.942948:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788845317.942959:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:6803:x1875740189534080:12345-0@lo:502: 00000100:00100000:1.0:1788845317.943320:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:6803:x1875740189534080:12345-0@lo:502: Request processed in 361us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845317.943329:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788845317.944220:0:6803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6803:1875740189534080:0@lo:502: 00000020:01000000:3.0:1788845317.944257:0:6803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788845317.944266:0:6803:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788845317.944274:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845317.944276:0:6803:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788845317.944286:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788845317.944289:0:6803:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.135@tcp to nid 0x20000c0a8ce87 (192.168.206.135@tcp) 00000020:01000000:3.0:1788845317.944328:0:6803:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788845317.944330:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788845317.944344:0:6803:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff92aeb4d48000) 00000020:00000080:3.0:1788845317.944389:0:6803:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788845317.944395:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788845317.944471:0:6803:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788845317.944476:0:6803:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788845317.944483:0:6803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6df95f9 00010000:00080000:3.0:1788845317.944512:0:6803:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92aeb79e5000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:3.0:1788845317.944769:0:6803:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:3.0:1788845317.981755:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788845318.090997:0:6803:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788845318.095076:0:6803:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788845318.095685:0:6803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845318.095868:0:6803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845318.095922:0:6803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788845318.095984:0:6803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788845318.099865:0:6808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845318.099875:0:6808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788845318.102600:0:6803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788845318.102615:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788845318.102655:0:6803:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788845318.102691:0:6803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd8041b54d6df9600 00000100:00080000:1.0:1788845318.102702:0:6803:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788845318.102708:0:6803:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92aeb79e5000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:1.0:1788845318.102744:0:6803:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aeae50a300 x1875740189534208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788845318.102774:0:6803:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788845318.102847:0:6803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845318.102852:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845318.102854:0:6803:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788845318.102858:0:6803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845318.102861:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845318.102863:0:6803:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788845318.102867:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788845318.102868:0:6803:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788845318.102896:0:6803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6803:1875740189534336:0@lo:502: 00000100:00100000:0.0:1788845318.103003:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189534208:0@lo:8: 00000100:00100000:1.0:1788845318.103004:0:6803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845318.103076:0:6803:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fd8b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788845318.103104:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845318.103106:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189534336 00000100:00100000:1.0:1788845318.103115:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189534336 00000100:00100000:1.0:1788845318.103166:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788845318.103175:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:6803:x1875740189534336:12345-0@lo:502: 00000100:00100000:0.0:1788845318.103195:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189534208 00000100:00100000:0.0:1788845318.103205:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189534208 00000100:00100000:0.0:1788845318.103242:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845318.103250:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875740189534208:12345-0@lo:8: 00010000:00080000:0.0:1788845318.103282:0:6656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 127 last 0 00000020:00000080:0.0:1788845318.103322:0:6656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd8041b54d6df9607 00002000:00100000:0.0:1788845318.103397:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff92ae885b5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788845318.103403:0:6656:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788845318.103408:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788845318.103547:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:6803:x1875740189534336:12345-0@lo:502: Request processed in 370us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845318.103558:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00002000:00100000:0.0:1788845318.103582:0:6656:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788845318.103639:0:6803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:6803:1875740189534336:0@lo:502: 00000020:01000000:1.0:1788845318.103691:0:6803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845318.103698:0:6803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845318.103700:0:6803:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788845318.103707:0:6803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00002000:00080000:0.0:1788845318.103838:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788845318.103868:0:6656:0:(import.c:65:import_set_state_nolock()) ffff92ae885b7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845318.104022:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875740189534208:12345-0@lo:8: Request processed in 770us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845318.104030:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788845318.104081:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeae50a300 x1875740189534208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788845328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845318.104093:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788845318.104102:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788845318.104111:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788845318.104117:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788845318.104120:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92aeb79e5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788845318.104137:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788845318.104143:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189534208:0@lo:8: 00000020:01000000:0.0:1788845318.109804:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788845318.109845:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788845318.109859:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845318.109874:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845318.109956:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788845318.109960:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92ae8ff0cd28 from 1 10000000:01000000:0.0:1788845318.109963:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788845318.110009:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845318.110018:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845318.110044:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845318.110072:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189534720:0@lo:101: 00000100:00100000:0.0:1788845318.110155:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845318.111277:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae93a9b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845318.111615:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189534464:0@lo:400: 00000100:00100000:3.0:1788845318.111698:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845318.111754:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845318.111763:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189534592:0@lo:400: 00000100:00100000:3.0:1788845318.111796:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845318.111867:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189534720 00000100:00100000:3.0:1788845318.111875:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189534720 00000100:00100000:3.0:1788845318.111916:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788845318.111925:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189534720:12345-0@lo:101: 00010000:00010000:3.0:1788845318.111940:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788845318.112703:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189534464 00000100:00100000:1.0:1788845318.112710:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189534464 00000100:00100000:1.0:1788845318.112744:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189534592 00000100:00100000:1.0:1788845318.112747:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189534592 00000100:00100000:1.0:1788845318.112769:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845318.112776:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189534464:12345-0@lo:400: 00000100:00100000:1.0:1788845318.112839:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189534464:12345-0@lo:400: Request processed in 63us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845318.112846:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845318.112864:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845318.112870:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189534592:12345-0@lo:400: 00000100:00100000:1.0:1788845318.112899:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189534592:12345-0@lo:400: Request processed in 30us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845318.112905:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788845318.112924:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788845318.113169:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aec2174600/0xd8041b54d6df9615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df960e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845318.113198:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aec2174600/0xd8041b54d6df9615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df960e expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845318.113211:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aec2174600/0xd8041b54d6df9615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df960e expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845318.113221:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aec2174600, rc 0) 00000100:00100000:3.0:1788845318.113258:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189534720:12345-0@lo:101: Request processed in 1333us (3104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845318.113264:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788845318.113318:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc8e1c00 x1875740189534592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845318.113332:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189534592:0@lo:400: 00010000:00080000:3.0:1788845318.113345:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc8e1500 x1875740189534464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845318.113353:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189534464:0@lo:400: 00000100:00100000:3.0:1788845318.113455:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189534720:0@lo:101: 00010000:00010000:3.0:1788845318.113483:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845318.113492:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845318.113558:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189534848:0@lo:501: 00000100:00100000:3.0:1788845318.113591:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845318.113628:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8647ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845318.113681:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189534848 00000100:00100000:0.0:1788845318.113694:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189534848 00000100:00100000:0.0:1788845318.113761:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788845318.113773:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189534848:12345-0@lo:501: 00000100:00100000:0.0:1788845318.114127:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189534848:12345-0@lo:501: Request processed in 356us (534us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788845318.114137:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788845318.114143:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189534848:0@lo:501: 10000000:01000000:3.0:1788845318.114185:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788845318.114193:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845318.114202:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788845318.114561:0:6808:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788845318.114873:0:6808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 127334509535ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788845318.190096:0:6809:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788845318.190136:0:6809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1875740189535104:0@lo:7: 00000100:00100000:2.0:1788845318.191408:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189534976:0@lo:13: 00000100:00100000:2.0:1788845318.205222:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845318.205511:0:6809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845318.205571:0:6809:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae93a9b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845318.207545:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189535104 00000100:00100000:1.0:1788845318.207558:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189535104 00000100:00100000:1.0:1788845318.207638:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845318.207651:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6809:x1875740189535104:12345-0@lo:7: 00000100:00080000:2.0:1788845318.209787:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845318.209997:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189534976 00000100:00100000:3.0:1788845318.210007:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189534976 00000100:00100000:3.0:1788845318.210190:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845318.210200:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875740189534976:12345-0@lo:13: 00002000:00000024:3.0:1788845318.210232:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00010000:00080000:2.0:1788845318.210436:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeb95bc000 x1875740189534976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845318.210457:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189534976:0@lo:13: 00000100:00100000:3.0:1788845318.210532:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875740189534976:12345-0@lo:13: Request processed in 333us (5318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845318.210539:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:1.0:1788845318.248037:0:6659:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788845318.248046:0:6659:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788845318.248518:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6809:x1875740189535104:12345-0@lo:7: Request processed in 40867us (43010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845318.248529:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788845318.251983:0:6809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeb95bea00 x1875740189535104/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788845334 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845318.252003:0:6809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1875740189535104:0@lo:7: 00000004:00080000:1.0:1788845318.252020:0:6809:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788845318.252077:0:6809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1875740189535232:0@lo:5: 00000100:00100000:1.0:1788845318.252145:0:6809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845318.252219:0:6809:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3ce26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845318.252337:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189535232 00000100:00100000:1.0:1788845318.252344:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189535232 00000100:00100000:1.0:1788845318.252431:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845318.252443:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6809:x1875740189535232:12345-0@lo:5: 00002000:00080000:1.0:1788845318.252471:0:6656:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788845318.252475:0:6656:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788845318.252851:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6809:x1875740189535232:12345-0@lo:5: Request processed in 409us (704us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788845318.252859:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788845318.253766:0:6809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeae50ad80 x1875740189535232/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845334 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845318.253790:0:6809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1875740189535232:0@lo:5: 00000004:00080000:0.0:1788845318.253816:0:6809:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788845318.253864:0:6809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1875740189535360:0@lo:700: 00000100:00100000:0.0:1788845318.253944:0:6809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845318.253983:0:6809:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae93a9b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845318.254015:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189535360 00000100:00100000:0.0:1788845318.254022:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189535360 00000100:00100000:0.0:1788845318.254085:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845318.254094:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6809:x1875740189535360:12345-0@lo:700: 00000100:00100000:0.0:1788845318.254131:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6665:1875740189535488:0@lo:700: 00000100:00100000:0.0:1788845318.254161:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845318.254176:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae93a9bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788845318.255623:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189535488 00000100:00100000:1.0:1788845318.255637:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189535488 00000100:00100000:1.0:1788845318.255696:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845318.255706:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6665:x1875740189535488:12345-0@lo:700: 00000004:00080000:0.0:1788845318.261264:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788845318.329549:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788845318.336052:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6665:x1875740189535488:12345-0@lo:700: Request processed in 80341us (81883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845318.336086:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788845318.336416:0:6665:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeb95bc000 x1875740189535488/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788845334 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845318.336497:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6665:1875740189535488:0@lo:700: 40000000:02000000:2.0:1788845318.336513:0:6665:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1788845318.483667:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6809:x1875740189535360:12345-0@lo:700: Request processed in 229556us (229704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845318.483683:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:0.0:1788845318.483721:0:6682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788845318.483732:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:0.0:1788845318.483777:0:6809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeb95bd880 x1875740189535360/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788845334 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845318.483793:0:6809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1875740189535360:0@lo:700: 00000004:02000040:0.0:1788845318.541393:0:6809:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788845318.551639:0:6809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1875740189535616:0@lo:5: 00000100:00100000:0.0:1788845318.551728:0:6809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845318.551775:0:6809:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae93a9b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845318.552226:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189535616 00000100:00100000:0.0:1788845318.552234:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189535616 00000100:00100000:0.0:1788845318.552291:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845318.552301:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6809:x1875740189535616:12345-0@lo:5: 00002000:00080000:2.0:1788845318.580006:0:6658:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788845318.580029:0:6658:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788845318.604474:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6809:x1875740189535616:12345-0@lo:5: Request processed in 52166us (52738us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788845318.604495:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788845318.604573:0:6809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeb95bd880 x1875740189535616/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845334 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845318.604587:0:6809:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788845318.604603:0:6809:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff92aeb95bd880 x1875740189535616/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845334 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845318.604616:0:6809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6809:1875740189535616:0@lo:5: 00000004:00080000:3.0:1788845318.604630:0:6809:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788845319.003526:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845320.027720:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845321.051616:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845322.079101:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788845322.799175:0:7026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788845323.099613:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845323.355572:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845323.355603:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189535744:0@lo:13: 00000100:00100000:2.0:1788845323.355693:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845323.356863:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189535744 00000100:00100000:2.0:1788845323.356879:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189535744 00000100:00100000:2.0:1788845323.356946:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845323.356957:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875740189535744:12345-0@lo:13: 00002000:00000024:2.0:1788845323.356994:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845323.357058:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875740189535744:12345-0@lo:13: Request processed in 103us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845323.357065:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788845323.357264:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845323.357984:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189535872:0@lo:400: 00000100:00100000:3.0:1788845323.358039:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845323.358077:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845323.358083:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189536000:0@lo:400: 00000100:00100000:3.0:1788845323.358109:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845323.358135:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845323.358143:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189536128:0@lo:400: 00000100:00100000:3.0:1788845323.358166:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845323.358192:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189535872 00000100:00100000:3.0:1788845323.358198:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189535872 00000100:00100000:3.0:1788845323.358231:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788845323.358239:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3283:x1875740189535872:12345-0@lo:400: 00000100:00100000:3.0:1788845323.358278:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3283:x1875740189535872:12345-0@lo:400: Request processed in 39us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845323.358291:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1788845323.361780:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebbccf100 x1875740189535744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845323.361819:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189535744:0@lo:13: 00000100:00100000:3.0:1788845323.363030:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189536000 00000100:00100000:3.0:1788845323.363042:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189536000 00000100:00100000:3.0:1788845323.363088:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189536128 00000100:00100000:3.0:1788845323.363092:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189536128 00000100:00100000:3.0:1788845323.363121:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845323.363130:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189536000:12345-0@lo:400: 00000100:00100000:3.0:1788845323.363225:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189536000:12345-0@lo:400: Request processed in 96us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845323.363233:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845323.363247:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845323.363254:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189536128:12345-0@lo:400: 00000100:00100000:3.0:1788845323.363287:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189536128:12345-0@lo:400: Request processed in 34us (5120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845323.363293:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788845323.364066:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788845323.364106:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc8e3480 x1875740189536128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845323.364122:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189536128:0@lo:400: 00010000:00080000:3.0:1788845323.364161:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc8e1c00 x1875740189536000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845323.364176:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189536000:0@lo:400: 00000100:00100000:3.0:1788845323.364189:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189535872:0@lo:400: 00000001:00080000:3.0:1788845323.458083:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788845324.124818:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845325.150359:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845326.171647:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845327.196077:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845328.219584:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845328.476496:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189536256:0@lo:13: 00000100:00100000:2.0:1788845328.476577:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845328.476672:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189536256 00000100:00100000:2.0:1788845328.476681:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189536256 00000100:00100000:2.0:1788845328.476749:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845328.476761:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189536256:12345-0@lo:13: 00002000:00000024:2.0:1788845328.476799:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845328.476861:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189536256:12345-0@lo:13: Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845328.476870:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788845328.476896:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845328.476945:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189536384:0@lo:400: 00000100:00100000:0.0:1788845328.476990:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845328.477021:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845328.477028:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189536512:0@lo:400: 00000100:00100000:0.0:1788845328.477057:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845328.477080:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189536640:0@lo:400: 00000100:00100000:0.0:1788845328.477096:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189536384 00000100:00100000:2.0:1788845328.477111:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845328.477113:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189536384 00000100:00100000:2.0:1788845328.477148:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189536512 00000100:00100000:0.0:1788845328.477153:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788845328.477154:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189536512 00000100:00100000:0.0:1788845328.477164:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3283:x1875740189536384:12345-0@lo:400: 00000100:00100000:2.0:1788845328.477188:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189536640 00000100:00100000:2.0:1788845328.477192:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189536640 00000100:00100000:0.0:1788845328.477206:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3283:x1875740189536384:12345-0@lo:400: Request processed in 43us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845328.477214:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788845328.477218:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788845328.477227:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189536512:12345-0@lo:400: 00000100:00100000:0.0:1788845328.477249:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788845328.477267:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189536512:12345-0@lo:400: Request processed in 41us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845328.477287:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788845328.477302:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788845328.477308:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189536640:12345-0@lo:400: 00000100:00100000:2.0:1788845328.477349:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189536640:12345-0@lo:400: Request processed in 41us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845328.477356:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788845328.477391:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788845328.477415:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeb95bc700 x1875740189536640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845328.477430:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189536640:0@lo:400: 00000100:00100000:0.0:1788845328.477563:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:0.0:1788845328.477642:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeb95bca80 x1875740189536512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845328.477653:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189536512:0@lo:400: 00000100:00100000:0.0:1788845328.477664:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189536384:0@lo:400: 00010000:00080000:3.0:1788845328.477869:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebbccf100 x1875740189536256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845328.477880:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788845328.477897:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189536256:0@lo:13: 00010000:00010000:3.0:1788845329.246258:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845330.270011:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845331.294526:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845332.317660:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845333.339928:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845333.595655:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845333.597033:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189536768:0@lo:13: 00000100:00100000:0.0:1788845333.597122:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845333.597234:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189536768 00000100:00100000:1.0:1788845333.597256:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189536768 00000100:00100000:1.0:1788845333.597330:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845333.597341:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189536768:12345-0@lo:13: 00002000:00000024:1.0:1788845333.597419:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845333.597487:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189536768:12345-0@lo:13: Request processed in 148us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845333.597495:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788845333.597545:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebbccca80 x1875740189536768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845333.597567:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189536768:0@lo:13: 00000100:00080000:0.0:1788845333.597825:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845333.597981:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189537024:0@lo:400: 00000100:00100000:3.0:1788845333.598020:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845333.598050:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845333.598056:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189536896:0@lo:400: 00000100:00100000:3.0:1788845333.598086:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845333.598117:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845333.598124:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189537152:0@lo:400: 00000100:00100000:3.0:1788845333.598149:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845333.598176:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189536896 00000100:00100000:3.0:1788845333.598181:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189536896 00000100:00100000:3.0:1788845333.598215:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788845333.598222:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3284:x1875740189536896:12345-0@lo:400: 00000100:00100000:3.0:1788845333.598275:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3284:x1875740189536896:12345-0@lo:400: Request processed in 53us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845333.598283:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788845333.598335:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189536896:0@lo:400: 00000100:00100000:3.0:1788845333.598730:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189537024 00000100:00100000:3.0:1788845333.598735:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189537024 00000100:00100000:3.0:1788845333.598771:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189537152 00000100:00100000:3.0:1788845333.598792:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189537152 00000100:00100000:3.0:1788845333.598836:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788845333.598843:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189537024:12345-0@lo:400: 00000100:00100000:3.0:1788845333.598888:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189537024:12345-0@lo:400: Request processed in 46us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845333.598894:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788845333.598907:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845333.598914:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189537152:12345-0@lo:400: 00000100:00100000:3.0:1788845333.598945:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189537152:12345-0@lo:400: Request processed in 32us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845333.598951:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788845333.598988:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc8e3480 x1875740189537152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845333.599000:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189537152:0@lo:400: 00010000:00080000:3.0:1788845333.599025:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc8e1c00 x1875740189537024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845333.599034:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189537024:0@lo:400: 00000100:00080000:1.0:1788845333.599114:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788845334.375248:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845335.389447:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788845335.425301:0:7595:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788845335.425306:0:7595:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788845335.425518:0:7595:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92aeb79e4000 00000020:01000004:1.0:1788845335.425539:0:7595:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788845335.425554:0:7595:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788845335.425581:0:7595:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff92aeb7723370) 00000020:00000080:1.0:1788845335.425601:0:7595:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788845335.443599:0:7595:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788845335.443883:0:7595:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788845335.479155:0:7595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788845335.484644:0:7595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788845335.484684:0:7595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788845335.484740:0:7595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788845335.484779:0:7595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788845335.485250:0:7595:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788845335.485264:0:7595:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788845335.485276:0:7595:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd8041b54d6df9623 00000020:01000004:1.0:1788845335.485284:0:7595:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788845335.485310:0:7595:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.135@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788845335.485314:0:7595:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788845335.485322:0:7595:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788845335.485347:0:7595:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788845335.485352:0:7595:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788845335.503226:0:7595:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788845335.503269:0:7595:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.135@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788845335.503277:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788845335.503279:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788845335.503280:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845335.503282:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845335.503283:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845335.503284:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845335.503285:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845335.503287:0:7595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845335.503288:0:7595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845335.503290:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845335.503291:0:7595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788845335.506038:0:7595:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788845335.506050:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788845335.506052:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788845335.506054:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845335.506055:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845335.506056:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845335.506058:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845335.506059:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845335.506061:0:7595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845335.506062:0:7595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845335.506064:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845335.506065:0:7595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788845335.506348:0:7595:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788845335.506396:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189537280:0@lo:253: 00000100:00100000:2.0:1788845335.506485:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845335.506548:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845335.506564:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189537280 00000100:00100000:0.0:1788845335.506704:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189537280 00000100:00100000:0.0:1788845335.507044:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788845335.507057:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:7595:x1875740189537280:12345-0@lo:253: 20000000:01000000:0.0:1788845335.507110:0:5812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788845335.507116:0:5812:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788845335.507122:0:5812:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788845335.507126:0:5812:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788845335.509314:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845335.509842:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788845335.509860:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788845335.509905:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788845335.509913:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788845335.509944:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788845335.510008:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788845335.510450:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788845335.510472:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.135@tcp 20000000:01000000:0.0:1788845335.510474:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.135@tcp (null) (null) (null) 00000040:00080000:0.0:1788845335.510502:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788845335.510509:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788845335.510563:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788845335.511006:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.135@tcp (null) (null) 00000040:00080000:0.0:1788845335.511057:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788845335.511066:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788845335.511165:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788845335.511314:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788845335.513055:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788845335.513168:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.135@tcp 20000000:01000000:2.0:1788845335.513171:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.135@tcp (null) (null) (null) 00000040:00080000:2.0:1788845335.513288:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788845335.513297:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788845335.513329:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788845335.513342:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.135@tcp (null) (null) 00000040:00080000:2.0:1788845335.513520:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788845335.513530:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788845335.513675:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788845335.513719:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788845335.513738:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788845335.513741:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788845335.513748:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788845335.513749:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788845335.513760:0:5812:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788845335.513774:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788845335.513776:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788845335.513815:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788845335.513818:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788845335.515099:0:7597:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788845335.515229:0:7597:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788845335.515264:0:7597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788845335.515743:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788845335.515789:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788845335.515845:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1788845335.515858:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788845335.515861:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788845335.519813:0:7598:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788845335.519904:0:7598:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788845335.519956:0:7598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788845335.520631:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788845335.520682:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788845335.520720:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788845335.520734:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788845335.520737:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788845335.521219:0:7599:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788845335.521261:0:7599:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788845335.521306:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788845335.521614:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788845335.521652:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788845335.521708:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788845335.521720:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788845335.521722:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788845335.522064:0:7600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788845335.523939:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788845335.524158:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788845335.524255:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:2.0:1788845335.524276:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788845335.524299:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.524321:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae81480e00/0xd8041b54d6df957b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9574 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.524328:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aec2175c00/0xd8041b54d6df95a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df959e expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.524334:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae81481200/0xd8041b54d6df95cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df95c8 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.524356:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df95eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df95e4 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.524408:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aec2174600/0xd8041b54d6df9615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df960e expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.524418:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.524468:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aec2174600/0xd8041b54d6df9615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df960e expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.524485:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92aec2174600/0xd8041b54d6df9615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df960e expref: 16 pid: 5811 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845335.524502:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189537408:0@lo:104: 00000100:00100000:2.0:1788845335.524780:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845335.524935:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df95eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df95e4 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.524946:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df95eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df95e4 expref: 16 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845335.524956:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788845335.524956:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbcce300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189537536:0@lo:104: 00000100:00100000:3.0:1788845335.524997:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189537408 00000100:00100000:2.0:1788845335.525003:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845335.525009:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189537408 00010000:00010000:2.0:1788845335.525039:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae81481200/0xd8041b54d6df95cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df95c8 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.525053:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae81481200/0xd8041b54d6df95cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df95c8 expref: 16 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845335.525071:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189537536 00000100:00100000:2.0:1788845335.525074:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccdc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189537664:0@lo:104: 00000100:00100000:3.0:1788845335.525078:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189537536 00000100:00100000:3.0:1788845335.525101:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788845335.525115:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9171b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:5812:x1875740189537408:12345-0@lo:104: 00000100:00100000:2.0:1788845335.525126:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845335.525136:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.525157:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aec2175c00/0xd8041b54d6df95a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df959e expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.525224:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92aec2175c00/0xd8041b54d6df95a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df959e expref: 16 pid: 5812 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845335.525236:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189537792:0@lo:104: 00000100:00100000:2.0:1788845335.525267:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845335.525292:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845335.525303:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9171b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:5812:x1875740189537408:12345-0@lo:104: Request processed in 191us (521us total) trans 0 rc 0/0 00010000:00010000:2.0:1788845335.525305:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae81480e00/0xd8041b54d6df957b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df9574 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845335.525333:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788845335.525336:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae81480e00/0xd8041b54d6df957b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df9574 expref: 16 pid: 5811 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845335.525352:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189537920:0@lo:104: 00000100:00100000:3.0:1788845335.525414:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189537664 00000100:00100000:3.0:1788845335.525420:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189537664 00000100:00100000:3.0:1788845335.525433:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189537792 00000100:00100000:3.0:1788845335.525436:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189537792 00000100:00100000:3.0:1788845335.525465:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788845335.525472:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845335.525482:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:5812:x1875740189537536:12345-0@lo:104: 00000100:00100000:2.0:1788845335.525490:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee0480 going to sleep for 11 seconds 00010000:00010000:3.0:1788845335.525494:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845335.525526:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189537408:0@lo:104: 00000100:00100000:2.0:1788845335.525551:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbcce300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189537536:0@lo:104: 00000100:00100000:0.0:1788845335.525617:0:5800:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788845335.525628:0:5800:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1788845335.526266:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189537920 00000100:00100000:0.0:1788845335.526272:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189537920 00000100:00100000:2.0:1788845335.526436:0:7601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788845335.526445:0:7601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+6:5812:x1875740189537664:12345-0@lo:104: 00010000:00010000:2.0:1788845335.526457:0:7601:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845335.526589:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccdc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189537664:0@lo:104: 00010000:00010000:1.0:1788845335.527408:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788845335.527417:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527427:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031200 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:1.0:1788845335.527432:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527442:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845335.527455:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845335.527474:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845335.527516:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527523:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845335.527546:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527554:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df960e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9615 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527584:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788845335.527589:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.527596:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788845335.527596:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52200 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:1.0:1788845335.527601:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845335.527609:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+6:5812:x1875740189537536:12345-0@lo:104: Request processed in 2129us (2606us total) trans 0 rc 0/0 00010000:00010000:1.0:1788845335.527611:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845335.527625:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845335.527626:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 10000000:01000000:1.0:1788845335.527635:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845335.527650:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527658:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788845335.527660:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845335.527673:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:5812:x1875740189537792:12345-0@lo:104: 00010000:00010000:1.0:1788845335.527683:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.527685:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527698:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df95e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95eb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527712:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845335.527716:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527723:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52a00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:1.0:1788845335.527726:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527733:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845335.527741:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845335.527746:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845335.527756:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788845335.527763:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845335.527764:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:5812:x1875740189537792:12345-0@lo:104: Request processed in 95us (2496us total) trans 0 rc 0/0 00010000:00010000:1.0:1788845335.527777:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788845335.527780:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788845335.527786:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527794:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae89a52a00/0xd8041b54d6df95c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845335.527798:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788845335.527807:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788845335.527818:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:5812:x1875740189537920:12345-0@lo:104: 00010000:00010000:1.0:1788845335.527820:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527830:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174a00 already unused, calling callback (ffffffffc1bfac20) 00010000:00010000:3.0:1788845335.527831:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845335.527834:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527850:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845335.527856:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845335.527862:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845335.527878:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527883:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845335.527888:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527894:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aec2174a00/0xd8041b54d6df959e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95a5 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.527904:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845335.527905:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845335.527907:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845335.527923:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189538048:0@lo:103: 00000100:00100000:1.0:1788845335.527966:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845335.527967:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845335.527976:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:5812:x1875740189537920:12345-0@lo:104: Request processed in 161us (2512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845335.527983:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788845335.528010:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788845335.528014:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788845335.528016:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.528023:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189538432:0@lo:103: 00010000:00010000:3.0:1788845335.528027:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481a00 already unused, calling callback (ffffffffc1bfac20) 00000100:00100000:1.0:1788845335.528060:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.528090:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189538176:0@lo:103: 10000000:00010000:3.0:1788845335.528105:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.528115:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845335.528123:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845335.528131:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845335.528137:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845335.528156:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.528156:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845335.528165:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189538304:0@lo:103: 00010000:00010000:3.0:1788845335.528166:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788845335.528189:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.528233:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189538048 00000100:00100000:1.0:1788845335.528240:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189538048 00010000:00010000:3.0:1788845335.528243:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528278:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aec2174600/0xd8041b54d6df9615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df960e expref: 17 pid: 5811 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.528296:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189538432 00000100:00100000:1.0:1788845335.528299:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189538432 00010000:00010000:1.0:1788845335.528310:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aec2175c00/0xd8041b54d6df95a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df959e expref: 18 pid: 5812 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.528319:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189538176 00000100:00100000:1.0:1788845335.528322:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189538176 00010000:00010000:1.0:1788845335.528331:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df95eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df95e4 expref: 19 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.528341:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189538304 00000100:00100000:1.0:1788845335.528346:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189538304 00010000:00010000:3.0:1788845335.528349:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae81481a00/0xd8041b54d6df9574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df957b expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528359:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae81481200/0xd8041b54d6df95cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df95c8 expref: 20 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.528390:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845335.528393:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845335.528397:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845335.528406:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845335.528407:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845335.528417:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+20:3286:x1875740189538048:12345-0@lo:103: 00000100:00100000:3.0:1788845335.528419:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189538560:0@lo:103: 00010000:00010000:1.0:1788845335.528429:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845335.528435:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aec2174600/0xd8041b54d6df9615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df960e expref: 20 pid: 5811 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528450:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aec2174600/0xd8041b54d6df9615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df960e expref: 20 pid: 5811 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528464:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aec2174600/0xd8041b54d6df9615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df960e expref: 20 pid: 5811 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528476:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845335.528501:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189538048:12345-0@lo:103: Request processed in 87us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.528508:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845335.528524:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788845335.528530:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3286:x1875740189538432:12345-0@lo:103: 00010000:00010000:1.0:1788845335.528538:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845335.528541:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aec2175c00/0xd8041b54d6df95a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df959e expref: 18 pid: 5812 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528550:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aec2175c00/0xd8041b54d6df95a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df959e expref: 18 pid: 5812 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528564:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845335.528607:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.528612:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3286:x1875740189538432:12345-0@lo:103: Request processed in 80us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.528620:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788845335.528637:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189538560 00000100:00100000:1.0:1788845335.528642:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189538560 00010000:00010000:1.0:1788845335.528654:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae81480e00/0xd8041b54d6df957b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9574 expref: 18 pid: 5811 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.528667:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788845335.528671:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aec2175c00/0xd8041b54d6df95a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df959e expref: 18 pid: 5812 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.528692:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:3283:x1875740189538176:12345-0@lo:103: 00000100:00100000:3.0:1788845335.528693:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189537792:0@lo:104: 00010000:00010000:1.0:1788845335.528705:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788845335.528712:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1875740189537920:0@lo:104: 00010000:00010000:1.0:1788845335.528713:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df95eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df95e4 expref: 17 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528727:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df95eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df95e4 expref: 17 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528739:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df95eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df95e4 expref: 17 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528755:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845335.528760:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.528789:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3283:x1875740189538176:12345-0@lo:103: Request processed in 102us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845335.528796:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189538432:0@lo:103: 00000100:00100000:1.0:1788845335.528797:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788845335.528813:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189538048:0@lo:103: 00000100:00100000:1.0:1788845335.528819:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788845335.528828:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:3283:x1875740189538304:12345-0@lo:103: 00010000:00010000:1.0:1788845335.528836:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845335.528843:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae81481200/0xd8041b54d6df95cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df95c8 expref: 15 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.528845:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845335.528855:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae81481200/0xd8041b54d6df95cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df95c8 expref: 15 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528866:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81481200/0xd8041b54d6df95cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df95c8 expref: 15 pid: 5810 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528875:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845335.528896:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:3283:x1875740189538304:12345-0@lo:103: Request processed in 71us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.528910:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788845335.528922:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845335.528929:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:3285:x1875740189538560:12345-0@lo:103: 00010000:00010000:1.0:1788845335.528936:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845335.528940:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae81480e00/0xd8041b54d6df957b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9574 expref: 13 pid: 5811 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528948:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae81480e00/0xd8041b54d6df957b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df9574 expref: 13 pid: 5811 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528963:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81480e00/0xd8041b54d6df957b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df9574 expref: 13 pid: 5811 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528975:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.528984:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.529000:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.529007:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.529009:0:7601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:1.0:1788845335.529015:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.529027:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845335.529030:0:7601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:5812:x1875740189537664:12345-0@lo:104: Request processed in 2584us (3902us total) trans 0 rc 0/0 00010000:00010000:1.0:1788845335.529045:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81480200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845335.529050:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.529058:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.529070:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.529080:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845335.529109:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3285:x1875740189538560:12345-0@lo:103: Request processed in 180us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.529116:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788845335.529122:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.529133:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.529140:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81480200/0xd8041b54d6df962a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.529151:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189538304:0@lo:103: 20000000:01000000:3.0:1788845335.529164:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788845335.529164:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189538176:0@lo:103: 00000100:00100000:1.0:1788845335.529190:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189538560:0@lo:103: 00000100:00100000:2.0:1788845335.529241:0:7601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788845335.529331:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845335.639665:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:7595:x1875740189537280:12345-0@lo:253: Request processed in 132592us (133161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.639681:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788845335.639870:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189537280:0@lo:253: 10000000:01000000:2.0:1788845335.639888:0:7595:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788845335.639892:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788845335.639894:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788845335.639895:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845335.639897:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788845335.639898:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845335.639900:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845335.639901:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788845335.639903:0:7595:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788845335.639905:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845335.639906:0:7595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788845335.639935:0:7595:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92aeb79e4000 from lustre-OST0001 10000000:01000000:2.0:1788845335.639965:0:7595:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788845335.639969:0:7595:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788845335.639977:0:7595:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92ae8ff0cd28 local copy 10000000:01000000:2.0:1788845335.639981:0:7595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788845335.640030:0:7595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.640041:0:7595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.640052:0:7595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845335.640074:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189538688:0@lo:101: 00000100:00100000:2.0:1788845335.640117:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845335.640171:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3ce2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788845335.642304:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189538688 00000100:00100000:1.0:1788845335.642323:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189538688 00000100:00100000:1.0:1788845335.642444:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788845335.642456:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:7595:x1875740189538688:12345-0@lo:101: 00010000:00010000:1.0:1788845335.642478:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845335.642649:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df9638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9631 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.642701:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df9638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9631 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.642714:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df9638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9631 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.642724:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a53c00, rc 0) 00000100:00100000:1.0:1788845335.642801:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189538688:12345-0@lo:101: Request processed in 347us (2683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.642808:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788845335.643040:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189538688:0@lo:101: 00010000:00010000:2.0:1788845335.643062:0:7595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.643073:0:7595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845335.643299:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189538816:0@lo:501: 00000100:00100000:2.0:1788845335.643335:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845335.643592:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3ce2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788845335.644090:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189538816 00000100:00100000:1.0:1788845335.644099:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189538816 00000100:00100000:1.0:1788845335.644160:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788845335.644171:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189538816:12345-0@lo:501: 00000100:00100000:1.0:1788845335.644486:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189538816:12345-0@lo:501: Request processed in 316us (1150us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788845335.644503:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788845335.644860:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189538816:0@lo:501: 10000000:01000000:2.0:1788845335.644884:0:7595:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788845335.644919:0:7595:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788845335.644927:0:7595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.644939:0:7595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.644948:0:7595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.644974:0:7595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788845335.644999:0:7595:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92aeb79e4000 10000000:01000000:2.0:1788845335.645004:0:7595:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788845335.645009:0:7595:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788845335.645012:0:7595:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788845335.645016:0:7595:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788845335.645027:0:7595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788845335.645057:0:7595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.645067:0:7595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.645076:0:7595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845335.645093:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189538944:0@lo:101: 00000100:00100000:2.0:1788845335.645129:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845335.645173:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3ce29c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788845335.645277:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845335.645285:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.645293:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81480e00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:3.0:1788845335.645298:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.645307:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845335.645316:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845335.645322:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845335.645346:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.645353:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845335.645408:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.645416:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd8041b54d6df9638 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.645431:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845335.645434:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845335.645435:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845335.645487:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845335.645509:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189539072:0@lo:103: 00000100:00100000:0.0:1788845335.645543:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845335.645682:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189539072 00000100:00100000:3.0:1788845335.645689:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189539072 00000100:00100000:3.0:1788845335.645744:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845335.645752:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3284:x1875740189539072:12345-0@lo:103: 00010000:00010000:3.0:1788845335.645765:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845335.645781:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae89a53c00/0xd8041b54d6df9638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df9631 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.645796:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845335.645835:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:3284:x1875740189539072:12345-0@lo:103: Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845335.645841:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845335.645871:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189539072:0@lo:103: 00000100:00100000:1.0:1788845335.645967:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189538944 00000100:00100000:1.0:1788845335.645971:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189538944 00000100:00100000:1.0:1788845335.646004:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788845335.646012:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:7595:x1875740189538944:12345-0@lo:101: 00010000:00010000:1.0:1788845335.646025:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845335.646039:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae89a52a00/0xd8041b54d6df9646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df963f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.646061:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae89a52a00/0xd8041b54d6df9646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df963f expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.646087:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae89a52a00/0xd8041b54d6df9646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df963f expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.646093:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a52a00, rc 0) 00000100:00100000:1.0:1788845335.646264:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189538944:12345-0@lo:101: Request processed in 252us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.646270:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788845335.647312:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189538944:0@lo:101: 00010000:00010000:3.0:1788845335.647337:0:7595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.647350:0:7595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845335.647562:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539200:0@lo:501: 00000100:00100000:0.0:1788845335.647619:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845335.647658:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb967bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845335.647757:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189539200 00000100:00100000:3.0:1788845335.647762:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189539200 00000100:00100000:3.0:1788845335.647803:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788845335.647812:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189539200:12345-0@lo:501: 00000100:00100000:3.0:1788845335.648149:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189539200:12345-0@lo:501: Request processed in 337us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845335.648168:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788845335.648693:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539200:0@lo:501: 00000100:00100000:1.0:1788845335.648743:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539328:0@lo:503: 00000100:00100000:1.0:1788845335.648793:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.648859:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc268840 going to sleep for 11 seconds 00000100:00100000:3.0:1788845335.648902:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189539328 00000100:00100000:3.0:1788845335.648915:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189539328 00000100:00100000:0.0:1788845335.657903:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788845335.657940:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189539328:12345-0@lo:503: 00000100:00100000:0.0:1788845335.658607:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189539328:12345-0@lo:503: Request processed in 684us (9809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845335.658619:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788845335.658642:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539328:0@lo:503: 00000040:00080000:1.0:1788845335.658983:0:7595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788845335.659077:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539456:0@lo:502: 00000100:00100000:1.0:1788845335.659133:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845335.659332:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189539456 00000100:00100000:0.0:1788845335.659350:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189539456 00000100:00100000:1.0:1788845335.659411:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc268840 going to sleep for 11 seconds 00000100:00100000:0.0:1788845335.659761:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788845335.659771:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189539456:12345-0@lo:502: 00000100:00100000:0.0:1788845335.659980:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189539456:12345-0@lo:502: Request processed in 210us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845335.659988:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788845335.663046:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539456:0@lo:502: 00000040:00080000:1.0:1788845335.663564:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788845335.663648:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788845335.663681:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788845335.663742:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788845335.663784:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788845335.663820:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788845335.663867:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539584:0@lo:502: 00000100:00100000:1.0:1788845335.663953:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.664012:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc268840 going to sleep for 11 seconds 00000100:00100000:0.0:1788845335.664128:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189539584 00000100:00100000:0.0:1788845335.664138:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189539584 00000100:00100000:0.0:1788845335.664215:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788845335.664226:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189539584:12345-0@lo:502: 00000100:00100000:0.0:1788845335.664495:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189539584:12345-0@lo:502: Request processed in 270us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845335.664514:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788845335.664996:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539584:0@lo:502: 00000040:00080000:3.0:1788845335.665159:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788845335.665185:0:7595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788845335.666029:0:7603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788845335.666038:0:7603:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788845335.666045:0:7603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845335.666048:0:7603:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788845335.666053:0:7603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788845335.666133:0:7603:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92aebc7b19b8) 00000020:00000080:3.0:1788845335.666160:0:7603:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788845335.666222:0:7603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788845335.666592:0:7603:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92aeb79e4000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788845335.666600:0:7603:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788845335.666607:0:7603:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd8041b54d6df9654 00010000:00010000:2.0:1788845335.678689:0:7603:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788845335.679074:0:7603:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788845335.684292:0:7603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788845335.684774:0:7603:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788845335.696712:0:7603:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788845335.697885:0:7603:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788845335.703216:0:7603:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788845335.703409:0:7603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845335.703418:0:7603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845335.703420:0:7603:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788845335.703425:0:7603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845335.703430:0:7603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845335.703431:0:7603:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788845335.703434:0:7603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788845335.703436:0:7603:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788845335.703582:0:7603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845335.703587:0:7603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845335.703588:0:7603:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788845335.703591:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788845335.705386:0:7595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788845335.705435:0:7595:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788845335.705464:0:7595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845335.705477:0:7595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845335.706418:0:7595:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92aeb79e4000 from 1 10000000:01000000:0.0:1788845335.706426:0:7595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845335.706481:0:7595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845335.706562:0:7595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845335.706599:0:7595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845335.706630:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539712:0@lo:101: 00000100:00100000:0.0:1788845335.706725:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845335.706775:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb967b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845335.706798:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189539712 00000100:00100000:0.0:1788845335.706806:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189539712 00000100:00100000:0.0:1788845335.706864:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788845335.706874:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:7595:x1875740189539712:12345-0@lo:101: 00010000:00010000:0.0:1788845335.706892:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845335.706905:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae80030600/0xd8041b54d6df9662 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df965b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845335.706933:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae80030600/0xd8041b54d6df9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df965b expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845335.706944:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae80030600/0xd8041b54d6df9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df965b expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845335.706955:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030600, rc 0) 00000100:00100000:0.0:1788845335.706997:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:7595:x1875740189539712:12345-0@lo:101: Request processed in 123us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845335.707004:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788845335.709407:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539712:0@lo:101: 00010000:00010000:0.0:1788845335.709446:0:7595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845335.709477:0:7595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845335.709807:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539840:0@lo:501: 00000100:00100000:0.0:1788845335.709870:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845335.709914:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb967b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845335.710633:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189539840 00000100:00100000:1.0:1788845335.710643:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189539840 00000100:00100000:1.0:1788845335.710704:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788845335.710714:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:7595:x1875740189539840:12345-0@lo:501: 00000100:00100000:1.0:1788845335.711042:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:7595:x1875740189539840:12345-0@lo:501: Request processed in 327us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.711050:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788845335.711111:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539840:0@lo:501: 00000100:00100000:1.0:1788845335.711606:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539968:0@lo:503: 00000100:00100000:1.0:1788845335.711661:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.711698:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189539968 00000100:00100000:1.0:1788845335.711704:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189539968 00000100:00100000:1.0:1788845335.711732:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788845335.711740:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:7595:x1875740189539968:12345-0@lo:503: 00000100:00100000:1.0:1788845335.713626:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:7595:x1875740189539968:12345-0@lo:503: Request processed in 1874us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.713651:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788845335.714016:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc268600 going to sleep for 11 seconds 00000100:00100000:2.0:1788845335.714049:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189539968:0@lo:503: 00000040:00080000:2.0:1788845335.716072:0:7595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788845335.716191:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540096:0@lo:502: 00000100:00100000:2.0:1788845335.716413:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845335.716462:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ebb1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845335.716595:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189540096 00000100:00100000:3.0:1788845335.716604:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189540096 00000100:00100000:3.0:1788845335.716679:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788845335.716690:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:7595:x1875740189540096:12345-0@lo:502: 00000100:00100000:3.0:1788845335.716972:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:7595:x1875740189540096:12345-0@lo:502: Request processed in 283us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845335.716980:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788845335.717472:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540096:0@lo:502: 00000040:00080000:2.0:1788845335.717788:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788845335.717847:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788845335.717889:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540224:0@lo:502: 00000100:00100000:2.0:1788845335.720511:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.721520:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189540224 00000100:00100000:1.0:1788845335.721534:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189540224 00000100:00100000:1.0:1788845335.721600:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788845335.721611:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:7595:x1875740189540224:12345-0@lo:502: 00000100:00100000:1.0:1788845335.721911:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:7595:x1875740189540224:12345-0@lo:502: Request processed in 301us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.721921:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788845335.722484:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ebb1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845335.722525:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540224:0@lo:502: 00000040:00080000:1.0:1788845335.722707:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788845335.722725:0:7595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788845335.724758:0:7607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845335.724774:0:7607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845335.724776:0:7607:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788845335.724785:0:7607:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92aeb79e4000 00000020:00000080:0.0:1788845335.724787:0:7607:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788845335.724814:0:7607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845335.724818:0:7607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845335.724820:0:7607:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788845335.724824:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788845335.725113:0:7595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788845335.725145:0:7595:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845335.725180:0:7595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.725195:0:7595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845335.725386:0:7595:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788845335.725400:0:7595:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92aeb79e4000 10000000:01000000:3.0:1788845335.725404:0:7595:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92aeb79e4000 10000000:01000000:3.0:1788845335.725408:0:7595:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845335.725416:0:7595:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92aeb79e4000 from 1 10000000:01000000:3.0:1788845335.725419:0:7595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788845335.725466:0:7595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.725475:0:7595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.725487:0:7595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845335.726022:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540352:0@lo:101: 00000100:00100000:3.0:1788845335.726096:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845335.726145:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845335.728491:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189540352 00000100:00100000:2.0:1788845335.728506:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189540352 00000100:00100000:2.0:1788845335.728584:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788845335.728597:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:7595:x1875740189540352:12345-0@lo:101: 00010000:00010000:2.0:1788845335.728617:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845335.728637:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae81480200/0xd8041b54d6df9670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9669 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.728671:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81480200/0xd8041b54d6df9670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9669 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.728685:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae81480200/0xd8041b54d6df9670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9669 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.728697:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae81480200, rc 0) 00000100:00100000:2.0:1788845335.728776:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:7595:x1875740189540352:12345-0@lo:101: Request processed in 181us (2679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845335.728784:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788845335.728849:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540352:0@lo:101: 00010000:00010000:3.0:1788845335.728882:0:7595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.728897:0:7595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845335.729035:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540480:0@lo:501: 00000100:00100000:3.0:1788845335.733782:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845335.733837:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845335.733856:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189540480 00000100:00100000:1.0:1788845335.733872:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189540480 00000100:00100000:1.0:1788845335.734019:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788845335.734032:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:7595:x1875740189540480:12345-0@lo:501: 00000100:00100000:1.0:1788845335.734796:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:7595:x1875740189540480:12345-0@lo:501: Request processed in 764us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.734807:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788845335.737659:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540480:0@lo:501: 00000100:00100000:0.0:1788845335.737754:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540608:0@lo:503: 00000100:00100000:0.0:1788845335.739531:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845335.739605:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb967b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845335.739623:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189540608 00000100:00100000:2.0:1788845335.739633:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189540608 00000100:00100000:2.0:1788845335.739694:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788845335.739704:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:7595:x1875740189540608:12345-0@lo:503: 00000100:00100000:2.0:1788845335.739967:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:7595:x1875740189540608:12345-0@lo:503: Request processed in 264us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845335.739975:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788845335.740239:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540608:0@lo:503: 00000040:00080000:0.0:1788845335.740616:0:7595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788845335.740707:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540736:0@lo:502: 00000100:00100000:0.0:1788845335.740753:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845335.740803:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb967b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845335.741038:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189540736 00000100:00100000:1.0:1788845335.741052:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189540736 00000100:00100000:1.0:1788845335.741120:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788845335.741131:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:7595:x1875740189540736:12345-0@lo:502: 00000100:00100000:1.0:1788845335.741470:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:7595:x1875740189540736:12345-0@lo:502: Request processed in 341us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.741482:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788845335.741717:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540736:0@lo:502: 00000040:00080000:0.0:1788845335.742154:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788845335.742466:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788845335.742506:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788845335.742555:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788845335.742603:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788845335.742648:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788845335.742683:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788845335.742715:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788845335.742777:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788845335.744252:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788845335.744297:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788845335.744405:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788845335.744659:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788845335.744713:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788845335.744779:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788845335.744816:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788845335.744852:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788845335.744897:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788845335.744997:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788845335.745036:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788845335.745120:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788845335.745226:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788845335.745263:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788845335.745302:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788845335.745330:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788845335.745355:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788845335.745436:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788845335.746046:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788845335.746108:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788845335.746175:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788845335.746214:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788845335.746245:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788845335.746274:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788845335.746346:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788845335.747055:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788845335.747116:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788845335.747215:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788845335.747280:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540864:0@lo:502: 00000100:00100000:1.0:1788845335.747401:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.747455:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc268f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845335.747509:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189540864 00000100:00100000:3.0:1788845335.747526:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189540864 00000100:00100000:3.0:1788845335.747620:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788845335.747649:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:7595:x1875740189540864:12345-0@lo:502: 00000100:00100000:3.0:1788845335.747973:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:7595:x1875740189540864:12345-0@lo:502: Request processed in 329us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845335.747980:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788845335.748045:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189540864:0@lo:502: 00000040:00080000:1.0:1788845335.748220:0:7595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788845335.748234:0:7595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788845335.754691:0:7608:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788845335.754711:0:7608:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff92aeb7720000) 00000020:00000080:1.0:1788845335.754737:0:7608:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788845335.754850:0:7608:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92aeb79e4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788845335.754855:0:7608:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92aeb79e4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788845335.754857:0:7608:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92aeb79e4000 3 00010000:00080000:1.0:1788845335.754892:0:7608:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92ad819a0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.135@tcp at head 00010000:00010000:1.0:1788845335.764044:0:7608:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788845335.764310:0:7608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788845335.764354:0:7608:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788845335.764387:0:7608:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd8041b54d6df967e 00000100:00080000:1.0:1788845335.767494:0:7608:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788845335.767507:0:7608:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92ad819a0800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:1.0:1788845335.767562:0:7608:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aeae508e00 x1875740189540992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788845335.767603:0:7608:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788845335.767701:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875740189540992:0@lo:38: 00000100:00100000:0.0:1788845335.767783:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845335.768603:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189540992 00000100:00100000:2.0:1788845335.768823:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189540992 00000100:00100000:2.0:1788845335.768879:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788845335.768887:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1875740189540992:12345-0@lo:38: 00010000:00080000:2.0:1788845335.768919:0:5818:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:2.0:1788845335.768960:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd8041b54d6df9685 00000004:00100000:2.0:1788845335.768980:0:5818:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788845335.769018:0:5818:0:(import.c:65:import_set_state_nolock()) ffff92ad813a3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845335.769101:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875740189540992:12345-0@lo:38: Request processed in 213us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845335.769110:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788845335.769136:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845335.769150:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189541120:0@lo:400: 00000100:00100000:1.0:1788845335.769331:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189541248:0@lo:400: 00000100:00100000:1.0:1788845335.769393:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.769421:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845335.769428:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189541376:0@lo:400: 00000100:00100000:1.0:1788845335.769456:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.769482:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189541248 00000100:00100000:1.0:1788845335.769486:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189541248 00000100:00100000:1.0:1788845335.769528:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845335.769535:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189541248:12345-0@lo:400: 00000100:00100000:1.0:1788845335.769600:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189541248:12345-0@lo:400: Request processed in 65us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.769607:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845335.769635:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189541376 00000100:00100000:1.0:1788845335.769639:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189541376 00000100:00100000:1.0:1788845335.769666:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845335.769673:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189541376:12345-0@lo:400: 00000100:00100000:1.0:1788845335.769703:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189541376:12345-0@lo:400: Request processed in 31us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.769709:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788845335.769724:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845335.769728:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788845335.769756:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeb95bf100 x1875740189541376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845335.769771:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189541376:0@lo:400: 00010000:00080000:1.0:1788845335.769781:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeb95bc380 x1875740189541248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845335.769789:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189541248:0@lo:400: 00000040:00080000:1.0:1788845335.769974:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1788845335.770148:0:7609:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff92aeae50b480 x1875740189541504/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845335.770170:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc268b40 going to sleep for 0 seconds 00000020:01000000:3.0:1788845335.770263:0:7595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788845335.770288:0:7595:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788845335.770313:0:7595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.770324:0:7595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788845335.770393:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788845335.770395:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788845335.770397:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845335.770398:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845335.770399:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845335.770401:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845335.770402:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845335.770404:0:7595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788845335.770406:0:7595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788845335.770408:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845335.770409:0:7595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788845335.770413:0:7595:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788845335.770415:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788845335.770417:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788845335.770418:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845335.770419:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845335.770420:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845335.770421:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845335.770422:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845335.770423:0:7595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788845335.770424:0:7595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788845335.770425:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845335.770426:0:7595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788845335.770446:0:7595:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788845335.770454:0:7595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189541632:0@lo:253: 00000100:00100000:3.0:1788845335.770497:0:7595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845335.770522:0:7595:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950300 going to sleep for 11 seconds 00000100:00100000:2.0:1788845335.772928:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788845335.773040:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeae508e00 x1875740189540992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845335.773053:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788845335.773066:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788845335.773076:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788845335.773081:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788845335.773085:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92ad819a0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788845335.773094:0:3282:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003ae27959): req@ffff92aeae50b480 x1875740189541504/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845335.773112:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875740189540992:0@lo:38: 00000100:00100000:2.0:1788845335.773213:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189541120 00000100:00100000:2.0:1788845335.773222:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189541120 00000100:00100000:2.0:1788845335.773271:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788845335.773282:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189541120:12345-0@lo:400: 00000100:00100000:2.0:1788845335.773359:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189541120:12345-0@lo:400: Request processed in 78us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845335.773389:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788845335.773425:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeb95bd500 x1875740189541120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845335.773435:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189541120:0@lo:400: 00000100:00100000:2.0:1788845335.775359:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189541632 00000100:00100000:2.0:1788845335.775395:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189541632 00000100:00100000:2.0:1788845335.775453:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788845335.775464:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:7595:x1875740189541632:12345-0@lo:253: 20000000:01000000:2.0:1788845335.775499:0:5810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788845335.775517:0:5810:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788845335.776281:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.776325:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189541504 00000100:00100000:1.0:1788845335.776329:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189541504 00000100:00100000:1.0:1788845335.776392:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845335.776401:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7609:x1875740189541504:12345-0@lo:901: 00000100:00100000:1.0:1788845335.776769:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7609:x1875740189541504:12345-0@lo:901: Request processed in 367us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.776779:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788845335.776815:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788845335.776854:0:7609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aeae50b480 x1875740189541504/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788845351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845335.776870:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7609:1875740189541504:0@lo:901: 20000000:01000000:1.0:1788845335.827949:0:5810:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788845335.827970:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788845335.828036:0:5833:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788845335.828042:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788845335.828077:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.828096:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae89a53a00/0xd8041b54d6df95dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df95d6 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.828106:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.828150:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae89a53a00/0xd8041b54d6df95dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df95d6 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845335.828166:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae89a53a00/0xd8041b54d6df95dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df95d6 expref: 14 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845335.828182:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875740189541760:0@lo:104: 00000100:00100000:3.0:1788845335.828263:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845335.828312:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae82d58e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845335.828465:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189541760 00000100:00100000:1.0:1788845335.828474:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189541760 00000100:00100000:1.0:1788845335.828549:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845335.828561:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:5833:x1875740189541760:12345-0@lo:104: 00010000:00010000:1.0:1788845335.828586:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.828659:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788845335.828666:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:5833:x1875740189541760:12345-0@lo:104: Request processed in 107us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.828673:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788845335.828698:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845335.828704:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.828712:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481c00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:1.0:1788845335.828716:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.828725:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845335.828733:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845335.828753:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845335.828786:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.828792:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845335.828810:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.828817:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df95d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df95dd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.828837:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845335.828838:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845335.828840:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845335.828849:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845335.828861:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189541888:0@lo:103: 00000100:00100000:1.0:1788845335.828899:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845335.828934:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189541888 00000100:00100000:1.0:1788845335.828938:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189541888 00010000:00010000:1.0:1788845335.828957:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae89a53a00/0xd8041b54d6df95dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df95d6 expref: 15 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.828978:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845335.828985:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:3284:x1875740189541888:12345-0@lo:103: 00010000:00010000:1.0:1788845335.828996:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845335.829001:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae89a53a00/0xd8041b54d6df95dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df95d6 expref: 15 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.829011:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae89a53a00/0xd8041b54d6df95dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df95d6 expref: 15 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.829034:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.829043:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788845335.829057:0:5802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006063946s 00010000:00010000:1.0:1788845335.829076:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.829084:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.829092:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.829098:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.829104:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845335.829109:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.829116:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.829125:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845335.829134:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845335.829164:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:3284:x1875740189541888:12345-0@lo:103: Request processed in 179us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.829175:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845335.829609:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189541888:0@lo:103: 00010000:00010000:2.0:1788845335.832715:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae89a53a00/0xd8041b54d6df95dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df95d6 expref: 14 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845335.832741:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5833:1875740189541760:0@lo:104: 00010000:00010000:2.0:1788845335.832771:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.832782:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.832789:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845335.832795:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aec2174200/0xd8041b54d6df968c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845335.851629:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:7595:x1875740189541632:12345-0@lo:253: Request processed in 76154us (81118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845335.851647:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788845335.851842:0:7595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:7595:1875740189541632:0@lo:253: 10000000:01000000:3.0:1788845335.851861:0:7595:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788845335.851864:0:7595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788845335.851866:0:7595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788845335.851867:0:7595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845335.851868:0:7595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845335.851869:0:7595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845335.851884:0:7595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845335.851885:0:7595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845335.851887:0:7595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788845335.851888:0:7595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788845335.851890:0:7595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845335.851892:0:7595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788845335.851926:0:7595:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788845335.862187:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788845335.862454:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788845335.862683:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788845335.862862:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788845335.863069:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788845335.863311:0:7595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788845335.865957:0:7595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788845336.208411:0:7595:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788845336.208420:0:7595:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788845336.208459:0:7595:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788845336.208530:0:7595:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788845336.208549:0:7595:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788845336.208590:0:7595:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788845336.413949:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845337.436907:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845338.460645:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845338.724591:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189542016:0@lo:13: 00000100:00100000:2.0:1788845338.724679:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845338.724991:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189542016 00000100:00100000:2.0:1788845338.725001:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189542016 00000100:00100000:2.0:1788845338.725073:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788845338.725082:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189542016:12345-0@lo:13: 00002000:00000024:2.0:1788845338.725137:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845338.725203:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189542016:12345-0@lo:13: Request processed in 122us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845338.725210:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788845338.725242:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788845338.725278:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb7e2b480 x1875740189542016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845338.725298:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189542016:0@lo:13: 00010000:00010000:1.0:1788845339.484845:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845340.514715:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845341.278144:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189542272:0@lo:400: 00000100:00100000:3.0:1788845341.278244:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845341.278248:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189542144:0@lo:400: 00000100:00100000:0.0:1788845341.278299:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845341.278330:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189542400:0@lo:400: 00000100:00100000:0.0:1788845341.278339:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189542656:0@lo:400: 00000100:00100000:3.0:1788845341.278388:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845341.278410:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845341.278413:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845341.278421:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189542528:0@lo:400: 00000100:00100000:3.0:1788845341.278451:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845341.278470:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189542272 00000100:00100000:0.0:1788845341.278480:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189542272 00000100:00100000:3.0:1788845341.278491:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189542400 00000100:00100000:3.0:1788845341.278497:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189542400 00000100:00100000:0.0:1788845341.278547:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189542656 00000100:00100000:0.0:1788845341.278551:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189542656 00000100:00100000:3.0:1788845341.278555:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788845341.278566:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189542272:12345-0@lo:400: 00000100:00100000:0.0:1788845341.278573:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845341.278582:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189542400:12345-0@lo:400: 00000100:00100000:3.0:1788845341.278633:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189542272:12345-0@lo:400: Request processed in 68us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845341.278639:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189542400:12345-0@lo:400: Request processed in 56us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845341.278646:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845341.278854:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845341.278872:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788845341.278879:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189542656:12345-0@lo:400: 00000100:00100000:0.0:1788845341.278981:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189542656:12345-0@lo:400: Request processed in 103us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845341.278988:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788845341.279029:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc8e2a00 x1875740189542400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845341.279060:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189542400:0@lo:400: 00010000:00080000:2.0:1788845341.279323:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc8e3b80 x1875740189542656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845341.279336:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189542656:0@lo:400: 00000100:00100000:3.0:1788845341.280730:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189542144 00000100:00100000:3.0:1788845341.280746:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189542144 00000100:00100000:3.0:1788845341.280829:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788845341.280839:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:3285:x1875740189542144:12345-0@lo:400: 00000100:00100000:3.0:1788845341.280948:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:3285:x1875740189542144:12345-0@lo:400: Request processed in 110us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845341.280956:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788845341.281003:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189542528 00000100:00100000:3.0:1788845341.281007:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189542528 00000100:00100000:3.0:1788845341.281047:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845341.281055:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189542528:12345-0@lo:400: 00000100:00100000:3.0:1788845341.281100:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189542528:12345-0@lo:400: Request processed in 46us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845341.281107:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788845341.281127:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845341.281131:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788845341.281698:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc8e2680 x1875740189542272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845341.281716:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189542272:0@lo:400: 00010000:00080000:3.0:1788845341.281756:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc8e0000 x1875740189542528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845341.281767:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189542528:0@lo:400: 00000100:00100000:0.0:1788845341.281955:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189542144:0@lo:400: 00010000:00010000:2.0:1788845341.532919:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788845342.021633:0:7951:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788845342.560588:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845343.580355:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788845343.835774:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788845343.835784:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ae8fcc6800 from 30 10000000:01000000:0.0:1788845343.835792:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788845343.835832:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.835846:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.835859:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845343.835883:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189542912:0@lo:101: 00000100:00100000:0.0:1788845343.835975:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845343.836038:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8ff75000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845343.836101:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189542912 00000100:00100000:2.0:1788845343.836126:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189542912 00000100:00100000:2.0:1788845343.836185:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788845343.836196:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189542912:12345-0@lo:101: 00010000:00010000:2.0:1788845343.836211:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845343.836224:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae81480600/0xd8041b54d6df969a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9693 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.836251:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81480600/0xd8041b54d6df969a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9693 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.836263:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae81480600/0xd8041b54d6df969a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9693 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.836273:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae81480600, rc 0) 00000100:00100000:2.0:1788845343.836447:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189542912:12345-0@lo:101: Request processed in 252us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845343.836454:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788845343.836740:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189542912:0@lo:101: 00010000:00010000:0.0:1788845343.836756:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.836778:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845343.836842:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189543040:0@lo:501: 00000100:00100000:0.0:1788845343.836872:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845343.836903:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8ff75000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845343.836977:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845343.836992:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189542784:0@lo:13: 00000100:00100000:1.0:1788845343.837027:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845343.837104:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189543040 00000100:00100000:2.0:1788845343.837109:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189543040 00000100:00100000:2.0:1788845343.837147:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788845343.837156:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189543040:12345-0@lo:501: 00000100:00100000:0.0:1788845343.837428:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189542784 00000100:00100000:0.0:1788845343.837433:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189542784 00000100:00100000:0.0:1788845343.837471:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845343.837477:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189542784:12345-0@lo:13: 00002000:00000024:0.0:1788845343.837506:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845343.837561:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189542784:12345-0@lo:13: Request processed in 83us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845343.837568:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788845343.837612:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb7e2b480 x1875740189542784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845343.837630:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189542784:0@lo:13: 00000100:00080000:3.0:1788845343.837725:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845343.838157:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189543040:12345-0@lo:501: Request processed in 999us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845343.838165:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788845343.838622:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189543040:0@lo:501: 00000100:00100000:0.0:1788845343.838683:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189543168:0@lo:503: 00000100:00100000:0.0:1788845343.838731:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845343.838781:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8ff75000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845343.839443:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189543168 00000100:00100000:2.0:1788845343.839454:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189543168 00000100:00100000:2.0:1788845343.839564:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788845343.839584:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189543168:12345-0@lo:503: 00000100:00100000:2.0:1788845343.839979:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189543168:12345-0@lo:503: Request processed in 405us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845343.839996:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788845343.840090:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189543168:0@lo:503: 00000100:00100000:0.0:1788845343.840648:0:8055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95be300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8055:1875740189543296:0@lo:502: 00000100:00100000:0.0:1788845343.840688:0:8055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845343.841842:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189543296 00000100:00100000:1.0:1788845343.841855:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189543296 00000100:00100000:0.0:1788845343.841866:0:8055:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8ff753c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.841982:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788845343.841990:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:8055:x1875740189543296:12345-0@lo:502: 00000100:00100000:0.0:1788845343.842306:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:8055:x1875740189543296:12345-0@lo:502: Request processed in 316us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845343.842312:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788845343.843683:0:8055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95be300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8055:1875740189543296:0@lo:502: 00000100:00100000:1.0:1788845343.843798:0:8055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8055:1875740189543424:0@lo:502: 00000100:00100000:1.0:1788845343.843866:0:8055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845343.843920:0:8055:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3e396c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845343.844119:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189543424 00000100:00100000:3.0:1788845343.844127:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189543424 00000100:00100000:3.0:1788845343.844183:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788845343.844193:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:8055:x1875740189543424:12345-0@lo:502: 00000100:00100000:3.0:1788845343.844708:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:8055:x1875740189543424:12345-0@lo:502: Request processed in 513us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845343.844723:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788845343.845020:0:8055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8055:1875740189543424:0@lo:502: 00000040:00080000:1.0:1788845343.845055:0:8055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788845343.845753:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788845343.845782:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788845343.845798:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845343.845812:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845343.845824:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788845343.845827:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788845343.845831:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788845343.845880:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845343.845947:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845343.845959:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845343.845983:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189543552:0@lo:101: 00000100:00100000:3.0:1788845343.846047:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845343.846099:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.846172:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189543552 00000100:00100000:0.0:1788845343.846182:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189543552 00000100:00100000:0.0:1788845343.846242:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788845343.846253:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189543552:12345-0@lo:101: 00010000:00010000:0.0:1788845343.846281:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845343.846424:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae80031600/0xd8041b54d6df96a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df96a1 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.846452:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae80031600/0xd8041b54d6df96a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df96a1 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.846463:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae80031600/0xd8041b54d6df96a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df96a1 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.846473:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031600, rc 0) 00000100:00100000:0.0:1788845343.846509:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189543552:12345-0@lo:101: Request processed in 258us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845343.846515:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788845343.846798:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189543552:0@lo:101: 00010000:00010000:3.0:1788845343.846814:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845343.846825:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845343.846900:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189543680:0@lo:501: 00000100:00100000:3.0:1788845343.846928:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845343.846957:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.847010:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189543680 00000100:00100000:0.0:1788845343.847015:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189543680 00000100:00100000:0.0:1788845343.847047:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788845343.847055:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189543680:12345-0@lo:501: 00000100:00100000:0.0:1788845343.847514:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189543680:12345-0@lo:501: Request processed in 460us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845343.847540:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788845343.847692:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189543680:0@lo:501: 00000100:00100000:3.0:1788845343.847722:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189543808:0@lo:503: 00000100:00100000:3.0:1788845343.847763:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845343.847796:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845343.847870:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189543808 00000100:00100000:1.0:1788845343.847874:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189543808 00000100:00100000:1.0:1788845343.847900:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788845343.847908:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189543808:12345-0@lo:503: 00000100:00100000:1.0:1788845343.848191:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189543808:12345-0@lo:503: Request processed in 284us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845343.848198:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788845343.848509:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189543808:0@lo:503: 00000100:00100000:1.0:1788845343.848936:0:8056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8056:1875740189543936:0@lo:502: 00000100:00100000:1.0:1788845343.848979:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845343.849016:0:8056:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3e39000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.849064:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189543936 00000100:00100000:0.0:1788845343.849069:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189543936 00000100:00100000:0.0:1788845343.849108:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788845343.849116:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:8056:x1875740189543936:12345-0@lo:502: 00000100:00100000:0.0:1788845343.849904:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:8056:x1875740189543936:12345-0@lo:502: Request processed in 786us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845343.849913:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788845343.849991:0:8056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8056:1875740189543936:0@lo:502: 00000020:01000000:1.0:1788845343.850025:0:8056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845343.850035:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845343.850037:0:8056:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788845343.850042:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788845343.850044:0:8056:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788845343.850066:0:8056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8056:1875740189544064:0@lo:502: 00000100:00100000:1.0:1788845343.850107:0:8056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845343.850175:0:8056:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3e39000 going to sleep for 11 seconds 00000100:00100000:3.0:1788845343.850207:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189544064 00000100:00100000:3.0:1788845343.850212:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189544064 00000100:00100000:3.0:1788845343.850250:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788845343.850480:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:8056:x1875740189544064:12345-0@lo:502: 00000100:00100000:3.0:1788845343.850672:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:8056:x1875740189544064:12345-0@lo:502: Request processed in 415us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845343.850680:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788845343.850755:0:8056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8056:1875740189544064:0@lo:502: 00000020:01000000:1.0:1788845343.850777:0:8056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845343.850781:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845343.850783:0:8056:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788845343.850786:0:8056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788845343.851009:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788845343.851032:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788845343.851044:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845343.851055:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845343.851066:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788845343.851069:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ae90de3800 from 30 10000000:01000000:3.0:1788845343.851078:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788845343.851106:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845343.851114:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845343.851123:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845343.851137:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189544192:0@lo:101: 00000100:00100000:3.0:1788845343.851164:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845343.851196:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.851252:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189544192 00000100:00100000:0.0:1788845343.851258:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189544192 00000100:00100000:0.0:1788845343.851293:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788845343.851311:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189544192:12345-0@lo:101: 00010000:00010000:0.0:1788845343.851321:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845343.851334:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae80031800/0xd8041b54d6df96b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df96af expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.851359:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae80031800/0xd8041b54d6df96b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df96af expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.851400:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae80031800/0xd8041b54d6df96b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df96af expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.851410:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031800, rc 0) 00000100:00100000:0.0:1788845343.851451:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189544192:12345-0@lo:101: Request processed in 142us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845343.851457:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788845343.851547:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189544192:0@lo:101: 00010000:00010000:1.0:1788845343.851560:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845343.851570:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845343.851623:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189544320:0@lo:501: 00000100:00100000:1.0:1788845343.851649:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845343.851674:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3e39000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.851819:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189544320 00000100:00100000:0.0:1788845343.851823:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189544320 00000100:00100000:0.0:1788845343.851850:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788845343.851857:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189544320:12345-0@lo:501: 00000100:00100000:0.0:1788845343.852116:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189544320:12345-0@lo:501: Request processed in 259us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845343.852123:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788845343.852193:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189544320:0@lo:501: 00000100:00100000:1.0:1788845343.852225:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189544448:0@lo:503: 00000100:00100000:1.0:1788845343.852258:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845343.852279:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3e39000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.852451:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189544448 00000100:00100000:0.0:1788845343.852455:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189544448 00000100:00100000:0.0:1788845343.852471:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788845343.852476:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189544448:12345-0@lo:503: 00000100:00100000:0.0:1788845343.852634:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189544448:12345-0@lo:503: Request processed in 157us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845343.852641:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788845343.852762:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189544448:0@lo:503: 00000100:00100000:1.0:1788845343.853177:0:8057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8057:1875740189544576:0@lo:502: 00000100:00100000:1.0:1788845343.853215:0:8057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845343.853248:0:8057:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3e39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.853292:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189544576 00000100:00100000:0.0:1788845343.853307:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189544576 00000100:00100000:0.0:1788845343.853340:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788845343.853348:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:8057:x1875740189544576:12345-0@lo:502: 00000100:00100000:0.0:1788845343.853881:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:8057:x1875740189544576:12345-0@lo:502: Request processed in 532us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845343.853889:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788845343.854532:0:8057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8057:1875740189544576:0@lo:502: 00000100:00100000:1.0:1788845343.854661:0:8057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8057:1875740189544704:0@lo:502: 00000100:00100000:1.0:1788845343.854705:0:8057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845343.854791:0:8057:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3e39c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845343.854863:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189544704 00000100:00100000:3.0:1788845343.854868:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189544704 00000100:00100000:3.0:1788845343.854955:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788845343.854965:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:8057:x1875740189544704:12345-0@lo:502: 00000100:00100000:3.0:1788845343.855169:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:8057:x1875740189544704:12345-0@lo:502: Request processed in 206us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845343.855175:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788845343.855237:0:8057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8057:1875740189544704:0@lo:502: 00000040:00080000:1.0:1788845343.855270:0:8057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788845343.855469:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788845343.855488:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845343.855500:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.855512:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845343.855532:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788845343.855543:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ae90de3800 from 5 10000000:01000000:0.0:1788845343.855547:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788845343.855589:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.855598:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.855609:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845343.855626:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189544832:0@lo:101: 00000100:00100000:0.0:1788845343.855661:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845343.856020:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae83fa99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845343.856103:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189544832 00000100:00100000:2.0:1788845343.856109:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189544832 00000100:00100000:2.0:1788845343.856140:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788845343.856149:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189544832:12345-0@lo:101: 00010000:00010000:2.0:1788845343.856161:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845343.856176:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae81481800/0xd8041b54d6df96c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df96bd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.856201:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81481800/0xd8041b54d6df96c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df96bd expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.856212:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae81481800/0xd8041b54d6df96c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df96bd expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.856221:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae81481800, rc 0) 00000100:00100000:2.0:1788845343.856272:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189544832:12345-0@lo:101: Request processed in 125us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845343.856279:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788845343.856543:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189544832:0@lo:101: 00010000:00010000:0.0:1788845343.856557:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.856567:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845343.856632:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189544960:0@lo:256: 00000100:00100000:0.0:1788845343.856668:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845343.856697:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae83fa99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845343.856799:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189544960 00000100:00100000:2.0:1788845343.856803:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189544960 00000100:00100000:2.0:1788845343.856826:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788845343.856832:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189544960:12345-0@lo:256: 20000000:01000000:2.0:1788845343.856848:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788845343.856868:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788845343.856871:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788845343.856961:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189544960:12345-0@lo:256: Request processed in 128us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845343.856975:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788845343.857052:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189544960:0@lo:256: 10000000:01000000:0.0:1788845343.857097:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788845343.857104:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.857122:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845343.857131:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788845343.857133:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788845343.857136:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788845343.857174:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.857181:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.857190:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845343.857203:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189545088:0@lo:101: 00000100:00100000:0.0:1788845343.857229:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845343.857530:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae90785a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845343.857598:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189545088 00000100:00100000:3.0:1788845343.857603:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189545088 00000100:00100000:2.0:1788845343.857717:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788845343.857725:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189545088:12345-0@lo:101: 00010000:00010000:2.0:1788845343.857734:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845343.857746:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae81481400/0xd8041b54d6df96d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df96cb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.857765:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81481400/0xd8041b54d6df96d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df96cb expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.857774:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae81481400/0xd8041b54d6df96d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df96cb expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.857783:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae81481400, rc 0) 00000100:00100000:2.0:1788845343.857819:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189545088:12345-0@lo:101: Request processed in 95us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845343.857826:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788845343.857898:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189545088:0@lo:101: 00010000:00010000:0.0:1788845343.857910:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845343.857918:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845343.857967:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189545216:0@lo:501: 00000100:00100000:0.0:1788845343.857992:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845343.858022:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae90785a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788845343.858070:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189545216 00000100:00100000:2.0:1788845343.858074:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189545216 00000100:00100000:2.0:1788845343.858092:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788845343.858098:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189545216:12345-0@lo:501: 00000100:00100000:2.0:1788845343.858901:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189545216:12345-0@lo:501: Request processed in 799us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845343.858910:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788845343.860236:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189545216:0@lo:501: 00000100:00100000:0.0:1788845343.860663:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189545344:0@lo:503: 00000100:00100000:0.0:1788845343.860752:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845343.860794:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae90785a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788845343.860879:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189545344 00000100:00100000:2.0:1788845343.860888:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189545344 00000100:00100000:2.0:1788845343.860941:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788845343.860953:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189545344:12345-0@lo:503: 00000100:00100000:0.0:1788845343.862036:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189545344:12345-0@lo:503: Request processed in 1079us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845343.862047:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788845343.862149:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189545344:0@lo:503: 00000100:00100000:2.0:1788845343.866313:0:8058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8058:1875740189545472:0@lo:502: 00000100:00100000:2.0:1788845343.866423:0:8058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845343.866470:0:8058:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc963300 going to sleep for 11 seconds 00000100:00100000:3.0:1788845343.866544:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189545472 00000100:00100000:3.0:1788845343.866552:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189545472 00000100:00100000:3.0:1788845343.866608:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788845343.866618:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:8058:x1875740189545472:12345-0@lo:502: 00000100:00100000:3.0:1788845343.866977:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:8058:x1875740189545472:12345-0@lo:502: Request processed in 359us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845343.866984:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788845343.867215:0:8058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8058:1875740189545472:0@lo:502: 00000020:01000000:2.0:1788845343.867252:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788845343.867270:0:8058:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788845343.867278:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845343.867280:0:8058:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788845343.867286:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788845343.867289:0:8058:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.135@tcp to nid 0x20000c0a8ce87 (192.168.206.135@tcp) 00000020:01000000:2.0:1788845343.867318:0:8058:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788845343.867320:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788845343.867335:0:8058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff92ae8ff099b8) 00000020:00000080:2.0:1788845343.867357:0:8058:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788845343.867395:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788845343.867484:0:8058:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788845343.867489:0:8058:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788845343.867496:0:8058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6df96e0 00010000:00080000:2.0:1788845343.867692:0:8058:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92aeb7591800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:2.0:1788845343.867907:0:8058:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788845343.868197:0:8058:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788845343.868207:0:8058:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788845343.868765:0:8058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845343.868969:0:8058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845343.869020:0:8058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788845343.869096:0:8058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788845343.879442:0:8059:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788845343.879451:0:8059:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788845343.880773:0:8058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788845343.880793:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788845343.880830:0:8058:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788845343.880866:0:8058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd8041b54d6df96e7 00000100:00080000:2.0:1788845343.880878:0:8058:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788845343.880884:0:8058:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92aeb7591800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:2.0:1788845343.880928:0:8058:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aeb7e2a300 x1875740189545600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788845343.880958:0:8058:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788845343.881077:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845343.881081:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845343.881084:0:8058:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788845343.881087:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845343.881091:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845343.881092:0:8058:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788845343.881095:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788845343.881096:0:8058:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788845343.881127:0:8058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8058:1875740189545728:0@lo:502: 00000100:00100000:2.0:1788845343.881210:0:8058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845343.881248:0:8058:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc963d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.881444:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189545600:0@lo:8: 00000100:00100000:0.0:1788845343.881483:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845343.881543:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189545728 00000100:00100000:0.0:1788845343.881552:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189545728 00000100:00100000:0.0:1788845343.881600:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788845343.881610:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:8058:x1875740189545728:12345-0@lo:502: 00000100:00100000:0.0:1788845343.881850:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:8058:x1875740189545728:12345-0@lo:502: Request processed in 241us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845343.881858:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788845343.882078:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189545600 00000100:00100000:2.0:1788845343.882082:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189545600 00000100:00100000:2.0:1788845343.882105:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788845343.882111:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875740189545600:12345-0@lo:8: 00010000:00080000:2.0:1788845343.882133:0:6658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:2.0:1788845343.882162:0:6658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd8041b54d6df96ee 00002000:00100000:2.0:1788845343.882179:0:6658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff92aeb7595800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788845343.882183:0:6658:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788845343.882187:0:6658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788845343.882449:0:6658:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788845343.882611:0:6658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788845343.882650:0:6658:0:(import.c:65:import_set_state_nolock()) ffff92aeb7597000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845343.882704:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875740189545600:12345-0@lo:8: Request processed in 592us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845343.882711:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788845343.882766:0:8058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8058:1875740189545728:0@lo:502: 00000020:01000000:2.0:1788845343.882815:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845343.882821:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845343.882823:0:8058:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788845343.882828:0:8058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:0.0:1788845343.883167:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb7e2a300 x1875740189545600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788845353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845343.883178:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788845343.883186:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788845343.883195:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788845343.883200:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788845343.883203:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92aeb7591800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788845343.883221:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788845343.883227:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189545600:0@lo:8: 00000004:00080000:2.0:1788845343.883652:0:8059:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788845343.883778:0:8059:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 153103415073ns, next at 0ns, rc = 0 00000020:01000000:1.0:1788845343.886784:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788845343.886827:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788845343.886853:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845343.886867:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845343.886878:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788845343.886881:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92ae8ff0cd28 from 1 10000000:01000000:1.0:1788845343.886884:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788845343.886945:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845343.886955:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845343.886967:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845343.886995:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189545856:0@lo:101: 00000100:00100000:1.0:1788845343.887200:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845343.887392:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3e39000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845343.887495:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189545856 00000100:00100000:2.0:1788845343.887505:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189545856 00000100:00100000:2.0:1788845343.887574:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788845343.887585:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189545856:12345-0@lo:101: 00010000:00010000:2.0:1788845343.887601:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845343.887616:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae81480400/0xd8041b54d6df96fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df96f5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.887644:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81480400/0xd8041b54d6df96fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df96f5 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.887655:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae81480400/0xd8041b54d6df96fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df96f5 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845343.887665:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae81480400, rc 0) 00000100:00100000:2.0:1788845343.887709:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189545856:12345-0@lo:101: Request processed in 126us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845343.887723:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788845343.887990:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845343.888011:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189545984:0@lo:400: 00000100:00100000:3.0:1788845343.888045:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845343.888079:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189545984 00000100:00100000:3.0:1788845343.888082:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189545984 00000100:00100000:3.0:1788845343.888113:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845343.888119:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189545984:12345-0@lo:400: 00000100:00100000:3.0:1788845343.888156:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189545984:12345-0@lo:400: Request processed in 37us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845343.888163:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788845343.888201:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc8e2680 x1875740189545984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845343.888215:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189545984:0@lo:400: 00000100:00100000:3.0:1788845343.888251:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875740189546112:0@lo:400: 00000100:00100000:3.0:1788845343.888286:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845343.888321:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189546112 00000100:00100000:3.0:1788845343.888325:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189546112 00000100:00100000:3.0:1788845343.888354:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788845343.888382:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875740189546112:12345-0@lo:400: 00000100:00100000:3.0:1788845343.888418:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875740189546112:12345-0@lo:400: Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845343.888425:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788845343.888451:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc8e2680 x1875740189546112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845343.888461:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875740189546112:0@lo:400: 00000100:00080000:3.0:1788845343.888475:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845343.888514:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189546240:0@lo:400: 00000100:00100000:3.0:1788845343.888557:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845343.888579:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189546240 00000100:00100000:3.0:1788845343.888582:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189546240 00000100:00100000:3.0:1788845343.888602:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788845343.888608:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189546240:12345-0@lo:400: 00000100:00100000:3.0:1788845343.888635:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189546240:12345-0@lo:400: Request processed in 27us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845343.888641:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788845343.888663:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc8e2680 x1875740189546240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845343.888673:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189546240:0@lo:400: 00000100:00080000:3.0:1788845343.888686:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845343.889611:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189545856:0@lo:101: 00010000:00010000:1.0:1788845343.889637:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845343.889650:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845343.889715:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189546368:0@lo:501: 00000100:00100000:1.0:1788845343.889754:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845343.889783:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3e39000 going to sleep for 11 seconds 00000100:00100000:3.0:1788845343.890080:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189546368 00000100:00100000:3.0:1788845343.890085:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189546368 00000100:00100000:3.0:1788845343.890126:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788845343.890135:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189546368:12345-0@lo:501: 00000100:00100000:3.0:1788845343.890698:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189546368:12345-0@lo:501: Request processed in 561us (940us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845343.890705:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788845343.891607:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189546368:0@lo:501: 10000000:01000000:1.0:1788845343.892979:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788845343.892996:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845343.895059:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845343.954483:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788845343.954771:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189546496:0@lo:13: 00000100:00100000:1.0:1788845343.954854:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845343.954932:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189546496 00000100:00100000:2.0:1788845343.954942:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189546496 00000100:00080000:0.0:1788845343.954984:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845343.955010:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788845343.955020:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189546496:12345-0@lo:13: 00002000:00000024:2.0:1788845343.955056:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:3.0:1788845343.955098:0:8060:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788845343.955150:0:8060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8060:1875740189546624:0@lo:7: 00000100:00100000:3.0:1788845343.955227:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845343.955266:0:8060:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.955294:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189546624 00000100:00100000:0.0:1788845343.955300:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189546624 00000100:00100000:0.0:1788845343.955344:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845343.955359:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8060:x1875740189546624:12345-0@lo:7: 00000100:00100000:2.0:1788845343.958417:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875740189546496:12345-0@lo:13: Request processed in 3390us (3554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845343.958434:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788845343.959828:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc8e2680 x1875740189546496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845343.959858:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189546496:0@lo:13: 00002000:00080000:2.0:1788845343.961668:0:6656:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788845343.961678:0:6656:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788845343.961783:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8060:x1875740189546624:12345-0@lo:7: Request processed in 6425us (6551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845343.961796:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788845343.961841:0:8060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc8e0e00 x1875740189546624/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788845359 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845343.961874:0:8060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8060:1875740189546624:0@lo:7: 00000004:00080000:3.0:1788845343.961888:0:8060:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788845343.961947:0:8060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8060:1875740189546752:0@lo:5: 00000100:00100000:3.0:1788845343.961998:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845343.962040:0:8060:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.962561:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189546752 00000100:00100000:0.0:1788845343.962571:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189546752 00000100:00100000:0.0:1788845343.962636:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845343.962648:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8060:x1875740189546752:12345-0@lo:5: 00002000:00080000:0.0:1788845343.962680:0:6659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788845343.962685:0:6659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788845343.962998:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8060:x1875740189546752:12345-0@lo:5: Request processed in 352us (999us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788845343.963006:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788845343.963192:0:8060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc8e0e00 x1875740189546752/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845359 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845343.963207:0:8060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8060:1875740189546752:0@lo:5: 00000004:00080000:3.0:1788845343.963219:0:8060:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788845343.963252:0:8060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8060:1875740189546880:0@lo:700: 00000100:00100000:3.0:1788845343.964023:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845343.964050:0:8060:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845343.964254:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189546880 00000100:00100000:0.0:1788845343.964262:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189546880 00000100:00100000:0.0:1788845343.964608:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845343.964619:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8060:x1875740189546880:12345-0@lo:700: 00000100:00100000:0.0:1788845343.964668:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6665:1875740189547008:0@lo:700: 00000100:00100000:0.0:1788845343.964710:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845343.964765:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fd8b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788845343.964785:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189547008 00000100:00100000:3.0:1788845343.964791:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189547008 00000100:00100000:3.0:1788845343.964825:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845343.964832:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6665:x1875740189547008:12345-0@lo:700: 40000000:02000000:0.0:1788845343.986881:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788845343.991171:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6665:x1875740189547008:12345-0@lo:700: Request processed in 26328us (26449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845343.991197:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788845343.991333:0:6665:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb95bc000 x1875740189547008/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788845359 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845343.991436:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6665:1875740189547008:0@lo:700: 40000000:02000000:0.0:1788845343.991452:0:6665:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788845344.040845:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788845344.040871:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788845344.041072:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8060:x1875740189546880:12345-0@lo:700: Request processed in 76450us (77057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845344.041091:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788845344.041173:0:8060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc8e2680 x1875740189546880/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788845359 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845344.041265:0:8060:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788845344.041287:0:8060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8060:1875740189546880:0@lo:700: 00000004:02000040:1.0:1788845344.068531:0:8060:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788845344.072559:0:8060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8060:1875740189547136:0@lo:5: 00000100:00100000:1.0:1788845344.072767:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845344.072889:0:8060:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3e39300 going to sleep for 11 seconds 00000100:00100000:2.0:1788845344.072956:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189547136 00000100:00100000:2.0:1788845344.072965:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189547136 00000100:00100000:2.0:1788845344.073053:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788845344.073063:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8060:x1875740189547136:12345-0@lo:5: 00002000:00080000:2.0:1788845344.079479:0:6656:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788845344.079507:0:6656:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788845344.084051:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8060:x1875740189547136:12345-0@lo:5: Request processed in 10980us (11275us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788845344.084067:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788845344.084286:0:8060:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeae50b100 x1875740189547136/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845360 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845344.084307:0:8060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8060:1875740189547136:0@lo:5: 00000004:00080000:1.0:1788845344.084323:0:8060:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788845344.603921:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845345.629474:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845346.654085:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788845346.725940:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788845347.102887:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845347.102940:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180086912 00000100:00100000:0.0:1788845347.102959:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180086912 00000100:00100000:0.0:1788845347.103010:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 111 00000100:00100000:0.0:1788845347.103020:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2371:x1875740180086912:12345-192.168.206.35@tcp:250: 00010000:00080000:0.0:1788845347.103053:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a83c90f8-270b-4823-9416-881b40e3aa44@192.168.206.35@tcp t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:0.0:1788845347.103084:0:5810:0:(genops.c:1385:class_connect()) connect: client a83c90f8-270b-4823-9416-881b40e3aa44, cookie 0xd8041b54d6df9703 00000100:00080000:0.0:1788845347.103293:0:5810:0:(import.c:65:import_set_state_nolock()) ffff92aeb79cc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845347.103396:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+5:2371:x1875740180086912:12345-192.168.206.35@tcp:250: Request processed in 376us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845347.103405:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 111 00000100:00100000:0.0:1788845347.111681:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845347.112087:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180087040 00000100:00100000:3.0:1788845347.112100:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180087040 00000100:00100000:3.0:1788845347.112174:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 112 00000100:00100000:3.0:1788845347.112204:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+5:5600:x1875740180087040:12345-192.168.206.35@tcp:101: 00010000:00010000:3.0:1788845347.112228:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845347.112249:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aec2174600/0xd8041b54d6df970a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce120077521e1 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845347.114769:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aec2174600/0xd8041b54d6df970a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077521e1 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845347.114823:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aec2174600/0xd8041b54d6df970a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077521e1 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845347.114835:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aec2174600, rc 0) 00000100:00100000:2.0:1788845347.114931:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+6:5600:x1875740180087040:12345-192.168.206.35@tcp:101: Request processed in 2729us (3263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845347.114939:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 112 00000100:00100000:2.0:1788845347.121647:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845347.121734:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180087168 00000100:00100000:3.0:1788845347.121746:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180087168 00000100:00100000:3.0:1788845347.121807:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 113 00000100:00100000:3.0:1788845347.121816:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+6:5600:x1875740180087168:12345-192.168.206.35@tcp:501: 00000100:00100000:1.0:1788845347.123961:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+6:5600:x1875740180087168:12345-192.168.206.35@tcp:501: Request processed in 2133us (2510us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788845347.126027:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 113 00000100:00100000:1.0:1788845347.132736:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845347.132873:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180087296 00000100:00100000:0.0:1788845347.132886:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180087296 00000100:00100000:0.0:1788845347.133288:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00100000:0.0:1788845347.133300:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+6:5600:x1875740180087296:12345-192.168.206.35@tcp:101: 00010000:00010000:0.0:1788845347.133320:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845347.133338:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6df9711 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce120077521e8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845347.133399:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6df9711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077521e8 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845347.133412:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6df9711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077521e8 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845347.133442:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1ee00, rc 0) 00000100:00100000:0.0:1788845347.133493:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+7:5600:x1875740180087296:12345-192.168.206.35@tcp:101: Request processed in 196us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845347.133499:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00100000:3.0:1788845347.135766:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845347.136078:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180087424 00000100:00100000:1.0:1788845347.136178:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180087424 00000100:00100000:1.0:1788845347.136243:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 115 00000100:00100000:1.0:1788845347.136254:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+7:5600:x1875740180087424:12345-192.168.206.35@tcp:501: 00000100:00100000:1.0:1788845347.136771:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+8:5600:x1875740180087424:12345-192.168.206.35@tcp:501: Request processed in 443us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845347.136779:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 115 00000100:00100000:1.0:1788845347.139812:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845347.139855:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180087552 00000100:00100000:1.0:1788845347.139869:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180087552 00000100:00100000:1.0:1788845347.139927:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:1.0:1788845347.139938:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+8:5600:x1875740180087552:12345-192.168.206.35@tcp:503: 00000100:00100000:1.0:1788845347.140265:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+8:5600:x1875740180087552:12345-192.168.206.35@tcp:503: Request processed in 324us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845347.140273:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:0.0:1788845347.145204:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845347.145623:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180087680 00000100:00100000:1.0:1788845347.145637:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180087680 00000100:00100000:1.0:1788845347.145706:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 117 00000100:00100000:1.0:1788845347.145718:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+8:5618:x1875740180087680:12345-192.168.206.35@tcp:502: 00000100:00100000:1.0:1788845347.146087:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+8:5618:x1875740180087680:12345-192.168.206.35@tcp:502: Request processed in 368us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845347.146095:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 117 00000100:00100000:3.0:1788845347.176184:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845347.176266:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180087808 00000100:00100000:0.0:1788845347.176287:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180087808 00000100:00100000:0.0:1788845347.176345:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 118 00000100:00100000:0.0:1788845347.176356:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+8:5618:x1875740180087808:12345-192.168.206.35@tcp:502: 00000100:00100000:0.0:1788845347.176658:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+8:5618:x1875740180087808:12345-192.168.206.35@tcp:502: Request processed in 303us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845347.176666:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 118 00000100:00100000:3.0:1788845347.183413:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845347.183535:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180087936 00000100:00100000:0.0:1788845347.183549:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180087936 00000100:00100000:0.0:1788845347.183618:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 119 00000100:00100000:0.0:1788845347.183629:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+8:5600:x1875740180087936:12345-192.168.206.35@tcp:101: 00010000:00010000:0.0:1788845347.183651:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845347.183671:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1e200/0xd8041b54d6df9718 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce12007752212 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845347.183709:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1e200/0xd8041b54d6df9718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752212 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845347.183723:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1e200/0xd8041b54d6df9718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752212 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845347.183757:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1e200, rc 0) 00000100:00100000:0.0:1788845347.183821:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+9:5600:x1875740180087936:12345-192.168.206.35@tcp:101: Request processed in 193us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845347.183828:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 119 00000100:00100000:0.0:1788845347.195570:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845347.195840:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180088064 00000100:00100000:3.0:1788845347.195868:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180088064 00000100:00100000:3.0:1788845347.195936:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 120 00000100:00100000:3.0:1788845347.195947:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+9:5600:x1875740180088064:12345-192.168.206.35@tcp:256: 20000000:01000000:3.0:1788845347.195980:0:5811:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788845347.196009:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788845347.196014:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788845347.196018:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788845347.196021:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788845347.200425:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+9:5600:x1875740180088064:12345-192.168.206.35@tcp:256: Request processed in 4464us (4854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845347.200442:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 120 00000100:00100000:1.0:1788845347.205816:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845347.206116:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180088192 00000100:00100000:3.0:1788845347.206130:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180088192 00000100:00100000:3.0:1788845347.207442:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 121 00000100:00100000:3.0:1788845347.207465:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+9:5600:x1875740180088192:12345-192.168.206.35@tcp:101: 00010000:00010000:3.0:1788845347.207488:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845347.207522:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aec2174200/0xd8041b54d6df971f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce12007752219 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845347.207573:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aec2174200/0xd8041b54d6df971f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752219 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845347.207586:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aec2174200/0xd8041b54d6df971f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752219 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845347.207597:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aec2174200, rc 0) 00000100:00100000:3.0:1788845347.207660:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:5600:x1875740180088192:12345-192.168.206.35@tcp:101: Request processed in 206us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845347.207667:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 121 00000100:00100000:1.0:1788845347.221492:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845347.223925:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180088320 00000100:00100000:3.0:1788845347.223947:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180088320 00000100:00100000:3.0:1788845347.224024:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:3.0:1788845347.224037:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+10:5600:x1875740180088320:12345-192.168.206.35@tcp:501: 00000100:00100000:3.0:1788845347.226247:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+10:5600:x1875740180088320:12345-192.168.206.35@tcp:501: Request processed in 2201us (4755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845347.226262:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:3.0:1788845347.229841:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845347.229957:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180088448 00000100:00100000:2.0:1788845347.229970:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180088448 00000100:00100000:2.0:1788845347.230034:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 123 00000100:00100000:2.0:1788845347.230046:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:5600:x1875740180088448:12345-192.168.206.35@tcp:503: 00000100:00100000:2.0:1788845347.230601:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:5600:x1875740180088448:12345-192.168.206.35@tcp:503: Request processed in 555us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845347.230611:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 123 00000100:00100000:1.0:1788845347.237789:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845347.238725:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180088576 00000100:00100000:3.0:1788845347.238741:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180088576 00000100:00100000:3.0:1788845347.238842:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 124 00000100:00100000:3.0:1788845347.238864:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:5623:x1875740180088576:12345-192.168.206.35@tcp:502: 00000100:00100000:3.0:1788845347.241600:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:5623:x1875740180088576:12345-192.168.206.35@tcp:502: Request processed in 304us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845347.241629:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 124 00000100:00100000:1.0:1788845347.241840:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845347.243745:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180088704 00000100:00100000:2.0:1788845347.243763:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180088704 00000100:00100000:2.0:1788845347.243823:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 125 00000100:00100000:2.0:1788845347.243835:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:5623:x1875740180088704:12345-192.168.206.35@tcp:502: 00000100:00100000:2.0:1788845347.244110:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:5623:x1875740180088704:12345-192.168.206.35@tcp:502: Request processed in 277us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845347.244118:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 125 00000100:00100000:1.0:1788845347.248478:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845347.249246:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180088832 00000100:00100000:3.0:1788845347.249260:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180088832 00000100:00100000:3.0:1788845347.249311:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:3.0:1788845347.249321:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2371:x1875740180088832:12345-192.168.206.35@tcp:38: 00010000:00080000:3.0:1788845347.249356:0:5819:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:3.0:1788845347.249431:0:5819:0:(genops.c:1385:class_connect()) connect: client 704fd1fa-8fb6-403c-867f-b875231088ec, cookie 0xd8041b54d6df9726 00000004:00100000:3.0:1788845347.249468:0:5819:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788845347.249474:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788845347.327757:0:5819:0:(import.c:65:import_set_state_nolock()) ffff92aeb95b4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845347.327977:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:2371:x1875740180088832:12345-192.168.206.35@tcp:38: Request processed in 78654us (79510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845347.327989:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00010000:00010000:1.0:1788845347.675662:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845348.336766:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845348.336874:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845348.340605:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180088960 00000100:00100000:3.0:1788845348.340633:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180088960 00000100:00080000:0.0:1788845348.340761:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845348.347005:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180089088 00000100:00100000:3.0:1788845348.347029:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180089088 00000100:00100000:0.0:1788845348.347169:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:0.0:1788845348.347186:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+7:0:x1875740180088960:12345-192.168.206.35@tcp:41: 00000004:00000024:0.0:1788845348.347244:0:5818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788845348.347397:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+7:0:x1875740180088960:12345-192.168.206.35@tcp:41: Request processed in 216us (10644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845348.347405:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:0.0:1788845348.347441:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:0.0:1788845348.347450:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:5600:x1875740180089088:12345-192.168.206.35@tcp:41: 00000004:00000024:0.0:1788845348.347463:0:5818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788845348.347484:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:5600:x1875740180089088:12345-192.168.206.35@tcp:41: Request processed in 36us (10611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845348.347490:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:1.0:1788845348.351103:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845348.353473:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180089216 00000100:00100000:0.0:1788845348.353493:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180089216 00000100:00100000:0.0:1788845348.353774:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:0.0:1788845348.353788:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:5600:x1875740180089216:12345-192.168.206.35@tcp:40: 00000100:00100000:0.0:1788845348.353911:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:5600:x1875740180089216:12345-192.168.206.35@tcp:40: Request processed in 127us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845348.353942:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:1.0:1788845348.356757:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845348.356919:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180089344 00000100:00100000:2.0:1788845348.356931:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180089344 00000100:00100000:2.0:1788845348.356993:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:2.0:1788845348.357004:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2371:x1875740180089344:12345-192.168.206.35@tcp:8: 00010000:00080000:2.0:1788845348.357061:0:6658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:2.0:1788845348.357095:0:6658:0:(genops.c:1385:class_connect()) connect: client 704fd1fa-8fb6-403c-867f-b875231088ec, cookie 0xd8041b54d6df972d 00002000:00100000:2.0:1788845348.357111:0:6658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 704fd1fa-8fb6-403c-867f-b875231088ec/ffff92aeb7594800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788845348.357139:0:6658:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788845348.357241:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845348.357385:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180089600 00000100:00100000:3.0:1788845348.357390:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180089600 00000100:00100000:3.0:1788845348.357433:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 126 00000100:00100000:3.0:1788845348.357440:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:2375:x1875740180089600:12345-192.168.206.35@tcp:400: 00000100:00100000:3.0:1788845348.357516:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:2375:x1875740180089600:12345-192.168.206.35@tcp:400: Request processed in 76us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845348.357524:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 126 00002000:00080000:2.0:1788845348.357585:0:6658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788845348.357618:0:6658:0:(import.c:65:import_set_state_nolock()) ffff92aeb7592000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845348.357844:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2371:x1875740180089344:12345-192.168.206.35@tcp:8: Request processed in 839us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845348.357852:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:3.0:1788845348.361063:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845348.361129:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845348.361232:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180089472 00000100:00100000:2.0:1788845348.361244:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180089472 00000100:00100000:2.0:1788845348.361482:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:2.0:1788845348.361493:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875740180089472:12345-192.168.206.35@tcp:8: 00010000:00080000:2.0:1788845348.361541:0:6656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:2.0:1788845348.361581:0:6656:0:(genops.c:1385:class_connect()) connect: client 704fd1fa-8fb6-403c-867f-b875231088ec, cookie 0xd8041b54d6df9734 00002000:00100000:2.0:1788845348.361595:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 704fd1fa-8fb6-403c-867f-b875231088ec/ffff92aeb7594000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788845348.361623:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788845348.362037:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788845348.362071:0:6656:0:(import.c:65:import_set_state_nolock()) ffff92aeb7596800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845348.362138:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2371:x1875740180089472:12345-192.168.206.35@tcp:8: Request processed in 645us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845348.362146:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:1.0:1788845348.363751:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180089728 00000100:00100000:1.0:1788845348.363766:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180089728 00000100:00100000:1.0:1788845348.363866:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:1.0:1788845348.363876:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:5600:x1875740180089728:12345-192.168.206.35@tcp:33: 00000004:00080000:1.0:1788845348.390601:0:5820:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26654us 00000004:00200000:1.0:1788845348.404208:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788845348.404349:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:5600:x1875740180089728:12345-192.168.206.35@tcp:33: Request processed in 40467us (43212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845348.404383:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:3.0:1788845348.518988:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845348.522179:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180089856 00000100:00100000:0.0:1788845348.522199:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180089856 00000100:00100000:1.0:1788845348.522672:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:1.0:1788845348.522687:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+6:5640:x1875740180089856:12345-192.168.206.35@tcp:101: 00010000:00010000:1.0:1788845348.522713:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845348.522743:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df973b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752243 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845348.522819:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df9742 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845348.522859:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df9742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845348.522877:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df9742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845348.522914:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845348.522918:0:7234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845348.522936:0:7234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df9742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845348.522965:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df973b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752243 expref: 8 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845348.522988:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df9742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752243 expref: 7 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845348.522999:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:1.0:1788845348.523003:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845348.523007:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a53200, rc 0) 00000100:00100000:1.0:1788845348.523219:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+7:5640:x1875740180089856:12345-192.168.206.35@tcp:101: Request processed in 534us (4244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845348.523228:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00010000:00010000:3.0:1788845348.699683:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845348.956932:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189547392:0@lo:13: 00000100:00100000:0.0:1788845348.956969:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189547648:0@lo:400: 00000100:00100000:1.0:1788845348.956992:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189547520:0@lo:400: 00000100:00100000:3.0:1788845348.957108:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189547264:0@lo:400: 00000100:00100000:2.0:1788845348.957176:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845348.957342:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189548032:0@lo:400: 00000100:00100000:2.0:1788845348.957419:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845348.957465:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189547392 00000100:00100000:2.0:1788845348.957476:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189547392 00000100:00100000:2.0:1788845348.957561:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788845348.957572:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189547392:12345-0@lo:13: 00002000:00000024:2.0:1788845348.957599:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845348.957670:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189547392:12345-0@lo:13: Request processed in 100us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845348.957677:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788845348.957706:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788845348.957742:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb7e2ad80 x1875740189547392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845348.957762:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189547392:0@lo:13: 00000100:00100000:2.0:1788845348.957807:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189548032 00000100:00100000:2.0:1788845348.957811:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189548032 00000100:00100000:2.0:1788845348.957841:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845348.957847:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189548032:12345-0@lo:400: 00000100:00100000:2.0:1788845348.957956:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189548032:12345-0@lo:400: Request processed in 109us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845348.957964:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788845348.957982:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788845348.957998:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb95bf100 x1875740189548032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845348.958005:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788845348.958017:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189548032:0@lo:400: 00000100:00100000:1.0:1788845348.960735:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845348.960814:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189547904:0@lo:400: 00000100:00100000:1.0:1788845348.960865:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845348.961387:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189547520 00000100:00100000:2.0:1788845348.961410:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189547520 00000100:00100000:2.0:1788845348.962145:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788845348.962157:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189547520:12345-0@lo:400: 00000100:00100000:0.0:1788845348.962596:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189547904 00000100:00100000:0.0:1788845348.962604:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189547904 00000100:00100000:0.0:1788845348.962652:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788845348.962660:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189547904:12345-0@lo:400: 00000100:00100000:1.0:1788845348.963855:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189547520:0@lo:400: 00000100:00080000:1.0:1788845348.963921:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845348.963977:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845348.964018:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788845348.964027:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788845348.964166:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189547648 00000100:00100000:1.0:1788845348.964173:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189547648 00000100:00100000:1.0:1788845348.964214:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788845348.964234:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788845348.964244:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189547648:12345-0@lo:400: 00000100:00100000:1.0:1788845348.964305:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189547648:12345-0@lo:400: Request processed in 62us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845348.964312:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788845348.964344:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845348.964392:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189547648:0@lo:400: 00000100:00100000:3.0:1788845348.964796:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845348.965466:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189547776:0@lo:400: 00000100:00100000:3.0:1788845348.965543:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845348.965619:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189547776 00000100:00100000:3.0:1788845348.965627:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189547776 00000100:00100000:3.0:1788845348.965673:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845348.965682:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189547776:12345-0@lo:400: 00000100:00100000:3.0:1788845348.965736:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189547776:12345-0@lo:400: Request processed in 54us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845348.965743:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788845348.965781:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb95bd500 x1875740189547776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845348.965795:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189547776:0@lo:400: 00000100:00100000:1.0:1788845348.966235:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189547264 00000100:00100000:1.0:1788845348.966249:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189547264 00000100:00100000:1.0:1788845348.966309:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788845348.966319:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189547264:12345-0@lo:400: 00000100:00100000:1.0:1788845348.966427:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189547264:12345-0@lo:400: Request processed in 109us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845348.966434:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788845348.966529:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189547264:0@lo:400: 00000100:00100000:2.0:1788845348.972342:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189547520:12345-0@lo:400: Request processed in 10172us (11604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845348.972359:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788845348.972594:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189547904:12345-0@lo:400: Request processed in 9933us (11726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845348.972604:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788845348.973462:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189547904:0@lo:400: 00000100:00100000:3.0:1788845349.469402:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845349.469435:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189548160:0@lo:13: 00000100:00100000:3.0:1788845349.469529:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845349.472878:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189548160 00000100:00100000:0.0:1788845349.472893:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189548160 00000100:00100000:0.0:1788845349.473098:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845349.473109:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189548160:12345-0@lo:13: 00002000:00000024:0.0:1788845349.473146:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845349.473471:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189548160:12345-0@lo:13: Request processed in 364us (3942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845349.473480:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788845349.474834:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeae509880 x1875740189548160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845349.474865:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189548160:0@lo:13: 00010000:00010000:1.0:1788845349.727341:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788845350.037479:0:6682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00010000:00010000:3.0:1788845350.749300:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845350.790295:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845350.790406:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180089984 00000100:00100000:1.0:1788845350.790419:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180089984 00000100:00100000:1.0:1788845350.790525:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:1.0:1788845350.790540:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:5692:x1875740180089984:12345-192.168.206.35@tcp:41: 00000004:00000024:1.0:1788845350.790594:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788845350.790699:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:5692:x1875740180089984:12345-192.168.206.35@tcp:41: Request processed in 165us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845350.790708:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00080000:2.0:1788845350.792388:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845350.795277:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845350.795469:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180090112 00000100:00100000:0.0:1788845350.795478:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180090112 00000100:00100000:0.0:1788845350.795566:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:0.0:1788845350.795578:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:704fd1fa-8fb6-403c-867f-b875231088ec+5:5692:x1875740180090112:12345-192.168.206.35@tcp:13: 00002000:00000024:0.0:1788845350.795617:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845350.795691:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:704fd1fa-8fb6-403c-867f-b875231088ec+5:5692:x1875740180090112:12345-192.168.206.35@tcp:13: Request processed in 116us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845350.795708:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00080000:2.0:1788845350.797119:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845350.798056:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845350.798142:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180090240 00000100:00100000:2.0:1788845350.798151:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180090240 00000100:00100000:2.0:1788845350.798230:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:2.0:1788845350.798240:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:704fd1fa-8fb6-403c-867f-b875231088ec+6:5692:x1875740180090240:12345-192.168.206.35@tcp:13: 00002000:00000024:2.0:1788845350.798285:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845350.798351:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:704fd1fa-8fb6-403c-867f-b875231088ec+6:5692:x1875740180090240:12345-192.168.206.35@tcp:13: Request processed in 113us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845350.798359:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00080000:1.0:1788845350.799688:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788845351.772654:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788845352.583341:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00010000:00010000:3.0:1788845352.797898:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788845353.121063:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00000001:02000400:0.0:1788845353.331086:0:8265:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788845353.691625:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845353.691676:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845353.691719:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845353.691756:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845353.691883:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180090496 00000100:00100000:0.0:1788845353.691896:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180090496 00000100:00100000:0.0:1788845353.691973:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:0.0:1788845353.691985:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180090496:12345-192.168.206.35@tcp:400: 00000100:00100000:0.0:1788845353.692073:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180090496:12345-192.168.206.35@tcp:400: Request processed in 91us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845353.692093:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:3.0:1788845353.692587:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180090368 00000100:00100000:3.0:1788845353.692593:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180090368 00000100:00100000:3.0:1788845353.692638:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 128 00000100:00100000:3.0:1788845353.692647:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:2375:x1875740180090368:12345-192.168.206.35@tcp:400: 00000100:00100000:3.0:1788845353.692753:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:2375:x1875740180090368:12345-192.168.206.35@tcp:400: Request processed in 44us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845353.692759:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 128 00000100:00100000:3.0:1788845353.692794:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180090624 00000100:00100000:3.0:1788845353.692798:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180090624 00000100:00100000:3.0:1788845353.692825:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180090752 00000100:00100000:3.0:1788845353.692828:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180090752 00000100:00100000:3.0:1788845353.692845:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:3.0:1788845353.692850:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2375:x1875740180090624:12345-192.168.206.35@tcp:400: 00000100:00100000:3.0:1788845353.692875:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2375:x1875740180090624:12345-192.168.206.35@tcp:400: Request processed in 25us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845353.692881:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:3.0:1788845353.692891:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:3.0:1788845353.692896:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2375:x1875740180090752:12345-192.168.206.35@tcp:400: 00000100:00100000:3.0:1788845353.692916:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2375:x1875740180090752:12345-192.168.206.35@tcp:400: Request processed in 20us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845353.692922:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00080000:1.0:1788845353.693272:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845353.693278:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845353.693280:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788845353.824129:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845354.075627:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189548288:0@lo:13: 00000100:00100000:2.0:1788845354.075959:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189548672:0@lo:400: 00000100:00100000:2.0:1788845354.076052:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845354.076201:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788845354.076208:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189548544:0@lo:400: 00000100:00100000:2.0:1788845354.076234:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845354.076253:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189549056:0@lo:400: 00000100:00100000:2.0:1788845354.076278:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845354.076319:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189548672 00000100:00100000:2.0:1788845354.076334:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189548672 00000100:00100000:0.0:1788845354.076342:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189548416:0@lo:400: 00000100:00100000:2.0:1788845354.076417:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189548544 00000100:00100000:2.0:1788845354.076421:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189548544 00000100:00100000:2.0:1788845354.076448:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788845354.076458:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189548672:12345-0@lo:400: 00000100:00100000:0.0:1788845354.076497:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845354.076530:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189548928:0@lo:400: 00000100:00100000:2.0:1788845354.076538:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189548672:12345-0@lo:400: Request processed in 80us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845354.076548:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788845354.076561:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845354.076571:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189548928 00000100:00100000:2.0:1788845354.076576:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189548928 00000100:00100000:0.0:1788845354.076586:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845354.076596:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189548800:0@lo:400: 00000100:00100000:2.0:1788845354.076600:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788845354.076610:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189548544:12345-0@lo:400: 00000100:00100000:0.0:1788845354.079439:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845354.079447:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189548544:12345-0@lo:400: Request processed in 2833us (3206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845354.079462:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788845354.079518:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788845354.079528:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189548416 00000100:00100000:2.0:1788845354.079535:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189548928:12345-0@lo:400: 00000100:00100000:0.0:1788845354.079539:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189548416 00000100:00100000:0.0:1788845354.079585:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788845354.079594:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189548416:12345-0@lo:400: 00000100:00100000:2.0:1788845354.079613:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189548928:12345-0@lo:400: Request processed in 86us (3052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845354.079621:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788845354.079771:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189549056 00000100:00100000:2.0:1788845354.079776:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189549056 00000100:00100000:2.0:1788845354.079807:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189548800 00000100:00100000:2.0:1788845354.079810:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189548800 00000100:00100000:2.0:1788845354.079826:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788845354.079833:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189549056:12345-0@lo:400: 00000100:00100000:2.0:1788845354.079868:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189549056:12345-0@lo:400: Request processed in 35us (3590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845354.079889:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788845354.079903:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788845354.079909:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189548800:12345-0@lo:400: 00000100:00100000:0.0:1788845354.080299:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189548416:12345-0@lo:400: Request processed in 705us (3801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845354.080307:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788845354.080398:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189548800:12345-0@lo:400: Request processed in 32us (512us total) trans 0 rc 0/0 00010000:00080000:0.0:1788845354.080403:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc787b80 x1875740189548800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845354.080410:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788845354.080426:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189548800:0@lo:400: 00000100:00100000:0.0:1788845354.080440:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189548416:0@lo:400: 00000100:00080000:2.0:1788845354.080452:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845354.080455:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189548928:0@lo:400: 00000100:00080000:2.0:1788845354.080458:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845354.080463:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845354.080506:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189548544:0@lo:400: 00010000:00080000:2.0:1788845354.080523:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc786a00 x1875740189549056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845354.080535:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189549056:0@lo:400: 00000100:00100000:2.0:1788845354.080549:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189548672:0@lo:400: 00000100:00100000:3.0:1788845354.080840:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845354.080926:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189548288 00000100:00100000:2.0:1788845354.080931:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189548288 00000100:00100000:2.0:1788845354.081192:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788845354.081202:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189548288:12345-0@lo:13: 00002000:00000024:2.0:1788845354.081238:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845354.081285:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189548288:12345-0@lo:13: Request processed in 85us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845354.081292:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788845354.082034:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb7e2ad80 x1875740189548288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845354.082090:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189548288:0@lo:13: 00000100:00100000:0.0:1788845354.594183:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845354.594215:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189549184:0@lo:13: 00000100:00100000:0.0:1788845354.594303:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845354.595404:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189549184 00000100:00100000:3.0:1788845354.595417:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189549184 00000100:00100000:3.0:1788845354.595479:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788845354.595489:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189549184:12345-0@lo:13: 00002000:00000024:3.0:1788845354.595533:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845354.595603:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189549184:12345-0@lo:13: Request processed in 115us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845354.595611:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788845354.595698:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc786680 x1875740189549184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845354.595719:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189549184:0@lo:13: 00010000:00010000:3.0:1788845354.844626:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845355.873699:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788845355.970770:0:8412:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0d478090 20000000:00000080:1.0:1788845355.970792:0:8412:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92ad82a66800 uarg=0000000000000000 20000000:01000000:1.0:1788845355.970830:0:8412:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788845355.970833:0:8412:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788845355.970836:0:8412:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788845355.970842:0:8412:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788845355.970848:0:8412:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788845355.970864:0:8412:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788845355.970866:0:8412:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788845355.971099:0:8412:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788845355.971103:0:8412:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788845355.972085:0:8413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788845355.972598:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788845355.972666:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788845355.972702:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788845355.972716:0:8412:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788845355.972718:0:8412:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788845355.973517:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788845355.974174:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788845355.974229:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788845355.974265:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788845355.974288:0:8412:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788845355.974290:0:8412:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788845355.976338:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788845355.976889:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788845355.976981:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788845355.977064:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788845355.977079:0:8412:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788845355.977082:0:8412:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788845355.979053:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788845355.980553:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788845355.980634:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788845355.980670:0:8412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1788845355.980690:0:8412:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788845355.980725:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.980746:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae89a52a00/0xd8041b54d6df9646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df963f expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.980755:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae81480200/0xd8041b54d6df9670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9669 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.980763:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae81480600/0xd8041b54d6df969a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9693 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.981928:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae80031600/0xd8041b54d6df96a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df96a1 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.981954:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae80031800/0xd8041b54d6df96b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df96af expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.981961:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae81481400/0xd8041b54d6df96d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df96cb expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.981968:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae81480400/0xd8041b54d6df96fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df96f5 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.981977:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aec2174600/0xd8041b54d6df970a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077521e1 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.981985:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6df9711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077521e8 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.981992:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.982061:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6df9711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e8 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.982080:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6df9711 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e8 expref: 9 pid: 5811 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.982099:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549312:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845355.982289:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aec2174600/0xd8041b54d6df970a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e1 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.982298:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92aec2174600/0xd8041b54d6df970a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e1 expref: 9 pid: 5811 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.982314:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549440:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845355.982347:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae81480400/0xd8041b54d6df96fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df96f5 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.982355:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae81480400/0xd8041b54d6df96fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df96f5 expref: 18 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.982386:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549568:0@lo:104: 00000100:00100000:3.0:1788845355.982428:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845355.982484:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae81481400/0xd8041b54d6df96d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df96cb expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.982493:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae81481400/0xd8041b54d6df96d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df96cb expref: 18 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.982500:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549696:0@lo:104: 00000100:00100000:3.0:1788845355.982525:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845355.982551:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae80031800/0xd8041b54d6df96b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df96af expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.982559:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae80031800/0xd8041b54d6df96b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df96af expref: 18 pid: 5811 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.982567:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549824:0@lo:104: 00010000:00010000:3.0:1788845355.982593:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae80031600/0xd8041b54d6df96a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df96a1 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.982600:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae80031600/0xd8041b54d6df96a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df96a1 expref: 18 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.982616:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549952:0@lo:104: 00010000:00010000:3.0:1788845355.982644:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae81480600/0xd8041b54d6df969a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df9693 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.982652:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae81480600/0xd8041b54d6df969a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df9693 expref: 18 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.982661:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189550080:0@lo:104: 00010000:00010000:3.0:1788845355.982686:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae81480200/0xd8041b54d6df9670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df9669 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.982693:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae81480200/0xd8041b54d6df9670 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df9669 expref: 18 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.982708:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189550208:0@lo:104: 00010000:00010000:3.0:1788845355.982748:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae89a52a00/0xd8041b54d6df9646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df963f expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.982757:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae89a52a00/0xd8041b54d6df9646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df963f expref: 18 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845355.982764:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788845355.982775:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189550336:0@lo:104: 00000100:00100000:2.0:1788845355.982790:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845355.982852:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189549568 00000100:00100000:0.0:1788845355.982863:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189549568 00000100:00100000:0.0:1788845355.982907:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189549696 00000100:00100000:0.0:1788845355.982910:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189549696 00000100:00100000:0.0:1788845355.982920:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189549824 00000100:00100000:0.0:1788845355.982922:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189549824 00000100:00100000:0.0:1788845355.982936:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845355.982946:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:8412:x1875740189549568:12345-0@lo:104: 00010000:00010000:0.0:1788845355.982959:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.983434:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845355.983503:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845355.984294:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e9506c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845355.985528:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845355.985548:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845355.985550:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845355.985562:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:8412:x1875740189549568:12345-0@lo:104: Request processed in 2615us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845355.985573:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845355.985626:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189550336 00000100:00100000:0.0:1788845355.985635:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189550336 00000100:00100000:0.0:1788845355.985661:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189549952 00000100:00100000:0.0:1788845355.985664:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189549952 00000100:00100000:0.0:1788845355.985674:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189550080 00000100:00100000:0.0:1788845355.985676:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189550080 00000100:00100000:0.0:1788845355.985685:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189550208 00000100:00100000:0.0:1788845355.985687:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189550208 00000100:00100000:2.0:1788845355.985701:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845355.985714:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7498c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+8:8412:x1875740189549696:12345-0@lo:104: 00010000:00010000:2.0:1788845355.985731:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.985786:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788845355.985791:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7498c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+8:8412:x1875740189549696:12345-0@lo:104: Request processed in 83us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845355.986939:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845355.986971:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845355.987032:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788845355.987044:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+7:8412:x1875740189550336:12345-0@lo:104: 00010000:00010000:2.0:1788845355.987057:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.987107:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788845355.987112:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+7:8412:x1875740189550336:12345-0@lo:104: Request processed in 74us (3689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845355.987118:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788845355.987142:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845355.987147:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+6:8412:x1875740189549952:12345-0@lo:104: 00010000:00010000:2.0:1788845355.987156:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.987187:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788845355.987193:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+6:8412:x1875740189549952:12345-0@lo:104: Request processed in 45us (3692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845355.987200:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845355.987216:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788845355.987223:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:8412:x1875740189550080:12345-0@lo:104: 00010000:00010000:2.0:1788845355.987231:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.987258:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788845355.987263:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:8412:x1875740189550080:12345-0@lo:104: Request processed in 42us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845355.987269:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788845355.987280:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788845355.987285:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:8412:x1875740189550208:12345-0@lo:104: 00010000:00010000:2.0:1788845355.987293:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.987320:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788845355.987325:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:8412:x1875740189550208:12345-0@lo:104: Request processed in 40us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845355.987330:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788845355.987356:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788845355.987381:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.987390:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52200 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845355.987395:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.987405:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845355.987413:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845355.987420:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845355.987480:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.987487:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788845355.987548:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189550464:0@lo:103: 00000100:00100000:1.0:1788845355.987610:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845355.987697:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:8412:x1875740189549824:12345-0@lo:104: 00010000:00010000:0.0:1788845355.987706:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.987742:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788845355.987748:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:8412:x1875740189549824:12345-0@lo:104: Request processed in 58us (4959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845355.987754:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788845355.987774:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:0.0:1788845355.987797:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189550464 00000100:00100000:0.0:1788845355.987803:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189550464 00010000:00010000:0.0:1788845355.987826:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae81480400/0xd8041b54d6df96fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df96f5 expref: 19 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845355.987852:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845355.987859:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc785880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189550464:12345-0@lo:103: 00010000:00010000:0.0:1788845355.987870:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845355.987876:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae81480400/0xd8041b54d6df96fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df96f5 expref: 19 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.987887:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae81480400/0xd8041b54d6df96fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df96f5 expref: 19 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.987912:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81480400/0xd8041b54d6df96fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df96f5 expref: 19 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.987931:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845355.987978:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.987986:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df96f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96fc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.987997:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788845355.988001:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.988008:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481200 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845355.988011:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.988025:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845355.988031:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845355.988036:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845355.988065:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.988072:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788845355.988289:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc785880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3283:x1875740189550464:12345-0@lo:103: Request processed in 430us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845355.988295:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845355.988426:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189550592:0@lo:103: 00000100:00100000:0.0:1788845355.988470:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845355.988504:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189550592 00000100:00100000:0.0:1788845355.988508:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189550592 00010000:00010000:0.0:1788845355.988522:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae89a52a00/0xd8041b54d6df9646 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df963f expref: 18 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845355.988550:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845355.988556:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3284:x1875740189550592:12345-0@lo:103: 00010000:00010000:0.0:1788845355.988642:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845355.988648:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae89a52a00/0xd8041b54d6df9646 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df963f expref: 18 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.988659:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae89a52a00/0xd8041b54d6df9646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df963f expref: 18 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.988671:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845355.988699:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3284:x1875740189550592:12345-0@lo:103: Request processed in 143us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845355.988705:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845355.988740:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189550592:0@lo:103: 00010000:00010000:0.0:1788845355.988849:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788845355.988857:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.988865:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1e800 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:0.0:1788845355.988869:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.988877:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845355.988884:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845355.988890:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845355.988908:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.988915:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845355.988930:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.988937:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6df96cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96d2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.988949:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788845355.988953:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.988959:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031200 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:0.0:1788845355.988968:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.988975:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845355.988981:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845355.988986:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845355.989001:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989007:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845355.989013:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989019:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae80031200/0xd8041b54d6df9693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df969a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989030:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788845355.989033:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989040:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2175c00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:0.0:1788845355.989043:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989049:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845355.989066:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845355.989072:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845355.989086:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989091:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845355.989100:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989105:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aec2175c00/0xd8041b54d6df9669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9670 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989116:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845355.989119:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989125:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174400 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:0.0:1788845355.989127:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989134:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845355.989140:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845355.989145:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845355.989179:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989186:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845355.989192:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989199:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aec2174400/0xd8041b54d6df96af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989209:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845355.989210:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845355.989212:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845355.989223:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189550720:0@lo:103: 00000100:00100000:0.0:1788845355.989253:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845355.989273:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845355.989278:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189550848:0@lo:103: 00000100:00100000:0.0:1788845355.989298:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845355.989324:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189551104:0@lo:103: 00000100:00100000:0.0:1788845355.989345:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845355.989359:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845355.989394:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189550976:0@lo:103: 00000100:00100000:0.0:1788845355.989415:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845355.989433:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189550720 00000100:00100000:0.0:1788845355.989437:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189550720 00010000:00010000:0.0:1788845355.989452:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae81481400/0xd8041b54d6df96d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df96cb expref: 18 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845355.989478:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189550848 00000100:00100000:0.0:1788845355.989481:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189550848 00010000:00010000:0.0:1788845355.989500:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae81480600/0xd8041b54d6df969a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9693 expref: 19 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845355.989511:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189551104 00000100:00100000:0.0:1788845355.989514:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189551104 00010000:00010000:0.0:1788845355.989524:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae80031800/0xd8041b54d6df96b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df96af expref: 20 pid: 5811 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845355.989533:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189550976 00000100:00100000:0.0:1788845355.989536:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189550976 00010000:00010000:0.0:1788845355.989545:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae81480200/0xd8041b54d6df9670 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9669 expref: 21 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845355.989558:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788845355.989669:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+21:3285:x1875740189550720:12345-0@lo:103: 00010000:00010000:0.0:1788845355.989679:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845355.989684:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae81481400/0xd8041b54d6df96d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df96cb expref: 21 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989694:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae81481400/0xd8041b54d6df96d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df96cb expref: 21 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989707:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845355.989739:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+21:3285:x1875740189550720:12345-0@lo:103: Request processed in 73us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845355.989746:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788845355.989761:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788845355.989767:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+20:3285:x1875740189550848:12345-0@lo:103: 00010000:00010000:0.0:1788845355.989775:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845355.989778:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae81480600/0xd8041b54d6df969a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9693 expref: 20 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989799:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae81480600/0xd8041b54d6df969a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df9693 expref: 20 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989810:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845355.989830:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845355.989838:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+20:3285:x1875740189550848:12345-0@lo:103: Request processed in 69us (537us total) trans 0 rc 0/0 00010000:00010000:2.0:1788845355.989846:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df963f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9646 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845355.989850:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788845355.989867:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845355.989869:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788845355.989871:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845355.989875:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845355.989879:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189551104:12345-0@lo:103: 00010000:00010000:0.0:1788845355.989887:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845355.989892:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae80031800/0xd8041b54d6df96b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df96af expref: 19 pid: 5811 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989900:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae80031800/0xd8041b54d6df96b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df96af expref: 19 pid: 5811 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989909:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845355.989941:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189551104:12345-0@lo:103: Request processed in 65us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845355.989947:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788845355.989960:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788845355.989966:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3284:x1875740189550976:12345-0@lo:103: 00010000:00010000:0.0:1788845355.989973:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845355.989978:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae81480200/0xd8041b54d6df9670 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9669 expref: 18 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.989985:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae81480200/0xd8041b54d6df9670 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df9669 expref: 18 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.990000:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845355.990022:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3284:x1875740189550976:12345-0@lo:103: Request processed in 56us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845355.990028:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788845355.990071:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189550848:0@lo:103: 00000100:00100000:0.0:1788845355.990078:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189550720:0@lo:103: 00000100:00100000:1.0:1788845355.990205:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189550464:0@lo:103: 00010000:00010000:0.0:1788845355.990216:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845355.990222:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.990228:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174000 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:0.0:1788845355.990232:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.990239:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845355.990246:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845355.990252:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845355.990279:0:8417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.990285:0:8417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845355.990299:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845355.990316:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aec2174000/0xd8041b54d6df96a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df96a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845355.990324:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189550976:0@lo:103: 00000100:00100000:3.0:1788845355.990339:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549568:0@lo:104: 00000100:00100000:0.0:1788845355.990342:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189551232:0@lo:103: 00000100:00100000:2.0:1788845355.990343:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189551104:0@lo:103: 00000100:00100000:0.0:1788845355.990406:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845355.990468:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845355.990471:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845355.990474:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845355.990481:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845355.990482:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189551232 00010000:00010000:0.0:1788845355.990484:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845355.990488:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189551232 00010000:00010000:2.0:1788845355.990511:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae80031600/0xd8041b54d6df96a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df96a1 expref: 18 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.990529:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845355.990542:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180090880 00000100:00100000:2.0:1788845355.990553:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180090880 00000100:00100000:3.0:1788845355.990568:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:2.0:1788845355.990573:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6df9711 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e8 expref: 10 pid: 5811 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845355.990591:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180091008 00000100:00100000:2.0:1788845355.990594:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180091008 00010000:00010000:2.0:1788845355.990609:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aec2174600/0xd8041b54d6df970a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e1 expref: 11 pid: 5811 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.990614:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788845355.990628:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3285:x1875740189551232:12345-0@lo:103: 00000100:00100000:2.0:1788845355.990633:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00010000:00010000:3.0:1788845355.990641:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788845355.990646:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a83c90f8-270b-4823-9416-881b40e3aa44+11:2373:x1875740180090880:12345-192.168.206.35@tcp:103: 00010000:00010000:3.0:1788845355.990651:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae80031600/0xd8041b54d6df96a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df96a1 expref: 18 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.990658:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788845355.990660:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:3.0:1788845355.990664:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae80031600/0xd8041b54d6df96a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df96a1 expref: 18 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.990667:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6df9711 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e8 expref: 11 pid: 5811 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845355.990672:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1788845355.990691:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6df9711 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e8 expref: 11 pid: 5811 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.990699:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845355.990705:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845355.990753:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a83c90f8-270b-4823-9416-881b40e3aa44+11:2373:x1875740180090880:12345-192.168.206.35@tcp:103: Request processed in 110us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845355.990754:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3285:x1875740189551232:12345-0@lo:103: Request processed in 127us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845355.990768:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:2.0:1788845355.990788:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:2.0:1788845355.990796:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a83c90f8-270b-4823-9416-881b40e3aa44+10:2372:x1875740180091008:12345-192.168.206.35@tcp:103: 00010000:00010000:2.0:1788845355.990807:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845355.990812:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aec2174600/0xd8041b54d6df970a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e1 expref: 10 pid: 5811 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.990822:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aec2174600/0xd8041b54d6df970a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e1 expref: 10 pid: 5811 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.990832:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788845355.990850:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845355.990852:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189551232:0@lo:103: 00010000:00010000:2.0:1788845355.990866:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.990883:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.990891:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.990898:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.990905:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.990912:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845355.990917:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.990925:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.990935:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845355.990948:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845355.990966:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81481400/0xd8041b54d6df96d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df96cb expref: 17 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845355.990974:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a83c90f8-270b-4823-9416-881b40e3aa44+10:2372:x1875740180091008:12345-192.168.206.35@tcp:103: Request processed in 176us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845355.990987:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549696:0@lo:104: 00000100:00100000:2.0:1788845355.990995:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00010000:00010000:3.0:1788845355.991004:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae80031800/0xd8041b54d6df96b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df96af expref: 16 pid: 5811 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.991014:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549824:0@lo:104: 00010000:00010000:3.0:1788845355.991025:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae80031600/0xd8041b54d6df96a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df96a1 expref: 15 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.991035:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549952:0@lo:104: 00010000:00010000:3.0:1788845355.991049:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81480600/0xd8041b54d6df969a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df9693 expref: 14 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.991059:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189550080:0@lo:104: 00010000:00010000:3.0:1788845355.991081:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81480200/0xd8041b54d6df9670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df9669 expref: 13 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.991091:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189550208:0@lo:104: 00010000:00010000:3.0:1788845355.991113:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae89a52a00/0xd8041b54d6df9646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df963f expref: 12 pid: 5810 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.991124:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189550336:0@lo:104: 00010000:00010000:3.0:1788845355.991137:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6df9711 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e8 expref: 9 pid: 5811 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.991146:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549312:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845355.991155:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aec2174600/0xd8041b54d6df970a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077521e1 expref: 8 pid: 5811 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845355.991164:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8412:1875740189549440:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845355.991193:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.991203:0:8412:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.991209:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845355.991215:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb748a400/0xd8041b54d6df9749 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845356.698555:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845356.698773:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180091136 00000100:00100000:0.0:1788845356.698786:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180091136 00000100:00100000:0.0:1788845356.699014:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 130 00000100:00100000:0.0:1788845356.699027:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+8:5614:x1875740180091136:12345-192.168.206.35@tcp:101: 00010000:00010000:0.0:1788845356.699049:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845356.699074:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1e800/0xd8041b54d6df9750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce1200775224a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845356.699111:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1e800/0xd8041b54d6df9750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775224a expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845356.699135:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1e800/0xd8041b54d6df9750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775224a expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845356.699147:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1e800, rc 0) 00000100:00100000:0.0:1788845356.699261:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+9:5614:x1875740180091136:12345-192.168.206.35@tcp:101: Request processed in 236us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845356.699288:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 130 00000100:00100000:2.0:1788845356.703429:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845356.703565:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180091264 00000100:00100000:0.0:1788845356.703578:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180091264 00000100:00100000:0.0:1788845356.703715:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 131 00000100:00100000:0.0:1788845356.703728:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+9:5614:x1875740180091264:12345-192.168.206.35@tcp:501: 00000100:00100000:0.0:1788845356.704087:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+9:5614:x1875740180091264:12345-192.168.206.35@tcp:501: Request processed in 360us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845356.704096:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 131 00000100:00100000:0.0:1788845356.708289:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845356.708403:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180091392 00000100:00100000:3.0:1788845356.708433:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180091392 00000100:00100000:3.0:1788845356.708521:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 132 00000100:00100000:3.0:1788845356.708533:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+9:5614:x1875740180091392:12345-192.168.206.35@tcp:503: 00000100:00100000:3.0:1788845356.709184:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+9:5614:x1875740180091392:12345-192.168.206.35@tcp:503: Request processed in 650us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845356.709967:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 132 00000100:00100000:1.0:1788845356.712283:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845356.712437:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180091520 00000100:00100000:0.0:1788845356.712450:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180091520 00000100:00100000:0.0:1788845356.712526:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 133 00000100:00100000:0.0:1788845356.712538:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+9:6081:x1875740180091520:12345-192.168.206.35@tcp:502: 00000100:00100000:0.0:1788845356.713131:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+9:6081:x1875740180091520:12345-192.168.206.35@tcp:502: Request processed in 593us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845356.713139:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 133 00000100:00100000:2.0:1788845356.715176:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845356.715415:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180091648 00000100:00100000:3.0:1788845356.715427:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180091648 00000100:00100000:3.0:1788845356.715567:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 134 00000100:00100000:3.0:1788845356.715578:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+9:6081:x1875740180091648:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788845356.717419:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+9:6081:x1875740180091648:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 1832us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845356.717433:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 134 00000100:00100000:3.0:1788845356.720846:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845356.721085:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180091776 00000100:00100000:0.0:1788845356.721098:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180091776 00000100:00100000:0.0:1788845356.721588:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 135 00000100:00100000:0.0:1788845356.721853:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+9:5614:x1875740180091776:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845356.721875:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845356.721897:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1fa00/0xd8041b54d6df9757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce12007752251 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845356.721933:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1fa00/0xd8041b54d6df9757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752251 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845356.721982:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1fa00/0xd8041b54d6df9757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752251 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845356.721993:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1fa00, rc 0) 00000100:00100000:0.0:1788845356.722063:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:5614:x1875740180091776:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 465us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845356.722070:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 135 00000100:00100000:0.0:1788845356.723939:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845356.724148:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180091904 00000100:00100000:3.0:1788845356.724159:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180091904 00000100:00100000:3.0:1788845356.724278:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 136 00000100:00100000:3.0:1788845356.724289:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:5614:x1875740180091904:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845356.724652:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:5614:x1875740180091904:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 363us (730us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845356.724661:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 136 00010000:00010000:0.0:1788845356.891889:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788845357.638149:0:8467:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf91f8720 20000000:00000080:1.0:1788845357.638172:0:8467:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92ad82a67800 uarg=0000000000000000 20000000:01000000:1.0:1788845357.638215:0:8467:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788845357.638223:0:8467:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788845357.638229:0:8467:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788845357.639546:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788845357.639749:0:8467:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788845357.644322:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788845357.644896:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788845357.644961:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788845357.644981:0:8467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788845357.645004:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.645026:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae89a53600/0xd8041b54d6df9535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df952e expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.645035:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae89a52400/0xd8041b54d6df9597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9590 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.645042:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae80030600/0xd8041b54d6df9662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df965b expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.645053:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aec2174200/0xd8041b54d6df971f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752219 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.645062:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.645121:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aec2174200/0xd8041b54d6df971f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752219 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.645141:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92aec2174200/0xd8041b54d6df971f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752219 expref: 9 pid: 5812 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845357.645157:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875740189551360:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845357.645395:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae80030600/0xd8041b54d6df9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df965b expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.645406:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae80030600/0xd8041b54d6df9662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df965b expref: 11 pid: 5811 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845357.645417:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875740189551488:0@lo:104: 00000100:00100000:0.0:1788845357.645476:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845357.645519:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae89a52400/0xd8041b54d6df9597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df9590 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.645529:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae89a52400/0xd8041b54d6df9597 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df9590 expref: 11 pid: 5812 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845357.645538:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875740189551616:0@lo:104: 00000100:00100000:0.0:1788845357.645566:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845357.645594:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae89a53600/0xd8041b54d6df9535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df952e expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.645603:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae89a53600/0xd8041b54d6df9535 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df952e expref: 11 pid: 5810 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845357.645623:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875740189551744:0@lo:104: 00000100:00100000:0.0:1788845357.645644:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98ef9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.646740:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788845357.646773:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.646802:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189551488 00000100:00100000:2.0:1788845357.646811:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189551488 00000100:00100000:2.0:1788845357.646857:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189551616 00000100:00100000:2.0:1788845357.646860:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189551616 00000100:00100000:2.0:1788845357.646872:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189551744 00000100:00100000:2.0:1788845357.646874:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189551744 00000100:00100000:2.0:1788845357.646890:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788845357.646899:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:8467:x1875740189551488:12345-0@lo:104: 00010000:00010000:2.0:1788845357.646915:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.646976:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788845357.646982:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:8467:x1875740189551488:12345-0@lo:104: Request processed in 85us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.646990:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788845357.647011:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788845357.647017:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb3e52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:8467:x1875740189551616:12345-0@lo:104: 00010000:00010000:2.0:1788845357.647025:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647057:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788845357.647062:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb3e52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:8467:x1875740189551616:12345-0@lo:104: Request processed in 46us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.647078:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788845357.647113:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845357.647120:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:8467:x1875740189551744:12345-0@lo:104: 00010000:00010000:2.0:1788845357.647128:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae80030200/0xd8041b54d6df952e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647161:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788845357.647167:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:8467:x1875740189551744:12345-0@lo:104: Request processed in 49us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.647173:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788845357.647198:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788845357.647205:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647213:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030e00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845357.647218:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647227:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845357.647235:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845357.647242:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845357.647281:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647288:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845357.647317:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647325:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae80030e00/0xd8041b54d6df965b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9662 expref: -99 pid: 7595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647343:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788845357.647346:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647353:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52e00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845357.647356:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647386:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845357.647393:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845357.647398:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845357.647412:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647417:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845357.647432:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647438:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae89a52e00/0xd8041b54d6df9590 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9597 expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647462:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845357.647471:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae80030200/0xd8041b54d6df952e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647478:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845357.647480:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae80030200/0xd8041b54d6df952e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647487:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae80030200/0xd8041b54d6df952e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845357.647492:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae80030200/0xd8041b54d6df952e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845357.647496:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845357.647510:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae80030200/0xd8041b54d6df952e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647515:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845357.647520:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae80030200/0xd8041b54d6df952e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647526:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae80030200/0xd8041b54d6df952e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9535 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647540:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845357.647541:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845357.647543:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845357.647558:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189551872:0@lo:103: 00000100:00100000:2.0:1788845357.647594:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.647641:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189552128:0@lo:103: 00000100:00100000:2.0:1788845357.647674:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.647694:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845357.647700:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189552000:0@lo:103: 00000100:00100000:2.0:1788845357.647720:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.647747:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189551872 00000100:00100000:2.0:1788845357.647752:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189551872 00010000:00010000:2.0:1788845357.647774:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae80030600/0xd8041b54d6df9662 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df965b expref: 12 pid: 5811 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.647794:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189552128 00000100:00100000:2.0:1788845357.647797:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189552128 00010000:00010000:2.0:1788845357.647808:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae89a53600/0xd8041b54d6df9535 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df952e expref: 13 pid: 5810 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.647828:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189552000 00000100:00100000:2.0:1788845357.647831:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189552000 00010000:00010000:2.0:1788845357.647842:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae89a52400/0xd8041b54d6df9597 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9590 expref: 14 pid: 5812 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.647855:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845357.647861:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:3286:x1875740189551872:12345-0@lo:103: 00010000:00010000:2.0:1788845357.647872:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845357.647878:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae80030600/0xd8041b54d6df9662 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df965b expref: 14 pid: 5811 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647888:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae80030600/0xd8041b54d6df9662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df965b expref: 14 pid: 5811 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647906:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845357.647935:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:3286:x1875740189551872:12345-0@lo:103: Request processed in 74us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.647948:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845357.647962:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788845357.647968:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:3284:x1875740189552128:12345-0@lo:103: 00010000:00010000:2.0:1788845357.647976:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845357.647980:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae89a53600/0xd8041b54d6df9535 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df952e expref: 13 pid: 5810 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647989:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae89a53600/0xd8041b54d6df9535 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df952e expref: 13 pid: 5810 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.647999:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845357.648025:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:3284:x1875740189552128:12345-0@lo:103: Request processed in 57us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.648031:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788845357.648043:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788845357.648049:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3284:x1875740189552000:12345-0@lo:103: 00010000:00010000:2.0:1788845357.648055:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845357.648059:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae89a52400/0xd8041b54d6df9597 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9590 expref: 12 pid: 5812 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.648068:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae89a52400/0xd8041b54d6df9597 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df9590 expref: 12 pid: 5812 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.648077:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845357.648099:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:3284:x1875740189552000:12345-0@lo:103: Request processed in 50us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.648105:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788845357.648142:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189551872:0@lo:103: 00000100:00100000:2.0:1788845357.648177:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189552000:0@lo:103: 00000100:00100000:2.0:1788845357.648184:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189552128:0@lo:103: 00010000:00010000:0.0:1788845357.649067:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845357.649075:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845357.649117:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae80030600/0xd8041b54d6df9662 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df965b expref: 11 pid: 5811 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845357.649131:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875740189551488:0@lo:104: 00010000:00010000:0.0:1788845357.649140:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae89a52400/0xd8041b54d6df9597 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df9590 expref: 10 pid: 5812 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845357.649147:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875740189551616:0@lo:104: 00010000:00010000:0.0:1788845357.649155:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae89a53600/0xd8041b54d6df9535 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df952e expref: 9 pid: 5810 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845357.649161:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875740189551744:0@lo:104: 00000100:00100000:0.0:1788845357.656068:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845357.656210:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180092032 00000100:00100000:3.0:1788845357.656223:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180092032 00010000:00010000:3.0:1788845357.656280:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aec2174200/0xd8041b54d6df971f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752219 expref: 10 pid: 5812 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845357.656325:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:3.0:1788845357.656351:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a83c90f8-270b-4823-9416-881b40e3aa44+10:2372:x1875740180092032:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845357.656396:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845357.656403:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aec2174200/0xd8041b54d6df971f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752219 expref: 10 pid: 5812 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.656416:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aec2174200/0xd8041b54d6df971f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752219 expref: 10 pid: 5812 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.656441:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.656461:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.656480:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.656487:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.656494:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.656501:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.656507:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1fc00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845357.656512:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.656526:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.656542:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.656554:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845357.656615:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aec2174200/0xd8041b54d6df971f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752219 expref: 10 pid: 5812 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845357.656616:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a83c90f8-270b-4823-9416-881b40e3aa44+10:2372:x1875740180092032:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 264us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845357.656631:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:1.0:1788845357.656642:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875740189551360:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845357.656812:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845357.656823:0:8467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845357.656830:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845357.656838:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df975e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845357.747571:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788845357.747589:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92aeb79e4000 from 39 10000000:01000000:1.0:1788845357.747597:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788845357.747650:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845357.747663:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845357.747677:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845357.747705:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc784380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189552256:0@lo:101: 00000100:00100000:1.0:1788845357.747790:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845357.747858:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.747876:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189552256 00000100:00100000:0.0:1788845357.747887:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189552256 00000100:00100000:0.0:1788845357.747959:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788845357.747970:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+9:5814:x1875740189552256:12345-0@lo:101: 00010000:00010000:0.0:1788845357.747985:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845357.748000:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1ea00/0xd8041b54d6df976c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9765 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.748027:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1ea00/0xd8041b54d6df976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9765 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.748055:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1ea00/0xd8041b54d6df976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9765 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.748065:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1ea00, rc 0) 00000100:00100000:0.0:1788845357.748128:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:5814:x1875740189552256:12345-0@lo:101: Request processed in 160us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.748136:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788845357.748175:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc784380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189552256:0@lo:101: 00010000:00010000:3.0:1788845357.748192:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.748201:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845357.748261:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189552384:0@lo:501: 00000100:00100000:3.0:1788845357.748288:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.748314:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.748382:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189552384 00000100:00100000:0.0:1788845357.748387:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189552384 00000100:00100000:0.0:1788845357.748413:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788845357.748419:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:5814:x1875740189552384:12345-0@lo:501: 00000100:00100000:0.0:1788845357.748711:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:5814:x1875740189552384:12345-0@lo:501: Request processed in 290us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.748719:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788845357.749082:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189552384:0@lo:501: 00000100:00100000:3.0:1788845357.749117:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189552512:0@lo:503: 00000100:00100000:3.0:1788845357.749160:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.749233:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45540 going to sleep for 11 seconds 00000100:00100000:1.0:1788845357.750255:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189552512 00000100:00100000:1.0:1788845357.750266:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189552512 00000100:00100000:1.0:1788845357.750327:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788845357.750337:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:5814:x1875740189552512:12345-0@lo:503: 00000100:00100000:1.0:1788845357.750646:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:5814:x1875740189552512:12345-0@lo:503: Request processed in 309us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845357.750656:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788845357.750743:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189552512:0@lo:503: 00000100:00100000:1.0:1788845357.751018:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc785500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8478:1875740189552640:0@lo:502: 00000100:00100000:1.0:1788845357.751083:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845357.751126:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.751554:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189552640 00000100:00100000:0.0:1788845357.751561:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189552640 00000100:00100000:0.0:1788845357.751601:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788845357.751610:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:8478:x1875740189552640:12345-0@lo:502: 00000100:00100000:0.0:1788845357.751841:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:8478:x1875740189552640:12345-0@lo:502: Request processed in 230us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.751849:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788845357.752053:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc785500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8478:1875740189552640:0@lo:502: 00000100:00100000:1.0:1788845357.752097:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc785500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8478:1875740189552768:0@lo:502: 00000100:00100000:1.0:1788845357.752139:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845357.752173:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788845357.752189:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189552768 00000100:00100000:3.0:1788845357.752195:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189552768 00000100:00100000:3.0:1788845357.752231:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788845357.752239:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:8478:x1875740189552768:12345-0@lo:502: 00000100:00100000:3.0:1788845357.752437:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:8478:x1875740189552768:12345-0@lo:502: Request processed in 199us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845357.752464:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788845357.752496:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc785500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8478:1875740189552768:0@lo:502: 00000040:00080000:1.0:1788845357.752518:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788845357.754522:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788845357.754554:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788845357.754565:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.754576:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845357.754584:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788845357.754586:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788845357.754589:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788845357.754622:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.754630:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.754643:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.754664:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189552896:0@lo:101: 00000100:00100000:2.0:1788845357.754735:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.754782:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea667c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.754889:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189552896 00000100:00100000:0.0:1788845357.754897:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189552896 00000100:00100000:0.0:1788845357.754965:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788845357.754985:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+10:5814:x1875740189552896:12345-0@lo:101: 00010000:00010000:0.0:1788845357.755000:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845357.755021:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1ec00/0xd8041b54d6df977a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9773 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.755058:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1ec00/0xd8041b54d6df977a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9773 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.755069:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1ec00/0xd8041b54d6df977a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9773 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.755078:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1ec00, rc 0) 00000100:00100000:0.0:1788845357.755125:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5814:x1875740189552896:12345-0@lo:101: Request processed in 142us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.755131:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788845357.755417:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189552896:0@lo:101: 00010000:00010000:2.0:1788845357.755432:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.755465:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.755525:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189553024:0@lo:501: 00000100:00100000:2.0:1788845357.755554:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.755577:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea667c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845357.755685:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189553024 00000100:00100000:3.0:1788845357.755690:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189553024 00000100:00100000:3.0:1788845357.755719:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788845357.755728:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5814:x1875740189553024:12345-0@lo:501: 00000100:00100000:3.0:1788845357.756027:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5814:x1875740189553024:12345-0@lo:501: Request processed in 299us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845357.756034:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788845357.757807:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189553024:0@lo:501: 00000100:00100000:2.0:1788845357.757867:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189553152:0@lo:503: 00000100:00100000:2.0:1788845357.757934:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.757979:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea667c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.758026:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189553152 00000100:00100000:0.0:1788845357.758033:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189553152 00000100:00100000:0.0:1788845357.758090:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788845357.758100:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5814:x1875740189553152:12345-0@lo:503: 00000100:00100000:0.0:1788845357.758458:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5814:x1875740189553152:12345-0@lo:503: Request processed in 347us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.758467:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788845357.758864:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189553152:0@lo:503: 00000100:00100000:3.0:1788845357.759318:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8480:1875740189553280:0@lo:502: 00000100:00100000:3.0:1788845357.759356:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.759418:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.759473:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189553280 00000100:00100000:0.0:1788845357.759479:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189553280 00000100:00100000:0.0:1788845357.759515:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788845357.759525:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:8480:x1875740189553280:12345-0@lo:502: 00000100:00100000:0.0:1788845357.759707:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:8480:x1875740189553280:12345-0@lo:502: Request processed in 183us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.759715:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788845357.759741:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8480:1875740189553280:0@lo:502: 00000020:01000000:3.0:1788845357.759766:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845357.759777:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845357.759779:0:8480:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788845357.759788:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788845357.759809:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8480:1875740189553408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.759843:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.759866:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.759876:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189553408 00000100:00100000:0.0:1788845357.759881:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189553408 00000100:00100000:0.0:1788845357.759917:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788845357.759924:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:8480:x1875740189553408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845357.760029:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:8480:x1875740189553408:12345-0@lo:502:llog_process_th.0 Request processed in 104us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.760036:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788845357.760561:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8480:1875740189553408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845357.760585:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845357.760590:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845357.760592:0:8480:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788845357.760596:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788845357.760751:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788845357.760770:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788845357.760782:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.760793:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845357.760802:0:5814:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788845357.760806:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92aeb79e4000 from 4 10000000:01000000:2.0:1788845357.760809:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845357.760840:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.760849:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.760868:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.760885:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189553536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.760921:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.760952:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea667c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.760964:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189553536 00000100:00100000:0.0:1788845357.760971:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189553536 00000100:00100000:0.0:1788845357.761004:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788845357.761012:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+11:5814:x1875740189553536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845357.761022:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845357.761036:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6df9788 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9781 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.761061:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6df9788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9781 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.761072:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6df9788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9781 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.761082:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f000, rc 0) 00000100:00100000:0.0:1788845357.761121:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189553536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.761196:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189553536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845357.761209:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.761219:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845357.761245:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788845357.761263:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189553664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.761287:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.761302:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea667c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.761320:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189553664 00000100:00100000:0.0:1788845357.761325:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189553664 00000100:00100000:0.0:1788845357.761355:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788845357.761387:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189553664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.761739:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189553664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.761752:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788845357.761858:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189553664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845357.761894:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc785500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189553792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845357.761934:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845357.762071:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.762147:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189553792 00000100:00100000:0.0:1788845357.762161:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189553792 00000100:00100000:0.0:1788845357.762221:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788845357.762229:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189553792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.762429:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189553792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.762437:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788845357.762529:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc785500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189553792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845357.762692:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8482:1875740189553920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.762734:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845357.762934:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189553920 00000100:00100000:1.0:1788845357.762938:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189553920 00000100:00100000:1.0:1788845357.762963:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788845357.762969:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:8482:x1875740189553920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845357.763105:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:8482:x1875740189553920:12345-0@lo:502:llog_process_th.0 Request processed in 136us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845357.763113:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788845357.763265:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45600 going to sleep for 11 seconds 00000100:00100000:3.0:1788845357.763280:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8482:1875740189553920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845357.763302:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845357.763313:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845357.763315:0:8482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788845357.763324:0:8482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92aeb79e4000 00000020:00000080:3.0:1788845357.763327:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788845357.763576:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8482:1875740189554048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.763614:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.763632:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845357.767337:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189554048 00000100:00100000:1.0:1788845357.767356:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189554048 00000100:00100000:1.0:1788845357.767469:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788845357.767480:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:8482:x1875740189554048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845357.768331:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:8482:x1875740189554048:12345-0@lo:502:llog_process_th.0 Request processed in 849us (4713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845357.768341:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788845357.768812:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8482:1875740189554048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845357.768853:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845357.768862:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845357.768865:0:8482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788845357.768871:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788845357.769016:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788845357.769039:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845357.769051:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.769063:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845357.769073:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788845357.769076:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ae8fcc6800 from 39 10000000:01000000:3.0:1788845357.769079:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788845357.769114:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.769123:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.769133:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845357.769168:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189554176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788845357.769211:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.769288:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.769323:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189554176 00000100:00100000:2.0:1788845357.769329:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189554176 00000100:00100000:2.0:1788845357.769434:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788845357.769444:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+12:5814:x1875740189554176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845357.769469:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845357.769488:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae81481a00/0xd8041b54d6df9796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df978f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.769516:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81481a00/0xd8041b54d6df9796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df978f expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.769528:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae81481a00/0xd8041b54d6df9796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df978f expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.769537:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae81481a00, rc 0) 00000100:00100000:2.0:1788845357.769572:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189554176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.769578:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788845357.769936:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189554176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845357.769950:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.769959:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.770015:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189554304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.770043:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.770101:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea667c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845357.770137:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189554304 00000100:00100000:3.0:1788845357.770142:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189554304 00000100:00100000:3.0:1788845357.770210:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788845357.770218:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189554304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845357.770539:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189554304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845357.770547:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788845357.770590:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189554304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.770629:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189554432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.770676:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.770718:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189554432 00000100:00100000:0.0:1788845357.770718:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae916a6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.770723:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189554432 00000100:00100000:2.0:1788845357.770766:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788845357.770774:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189554432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.770928:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189554432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.770942:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788845357.770957:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189554432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845357.772223:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8484:1875740189554560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.772267:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.772301:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.772305:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189554560 00000100:00100000:0.0:1788845357.772310:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189554560 00000100:00100000:0.0:1788845357.772347:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788845357.772354:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:8484:x1875740189554560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845357.772578:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:8484:x1875740189554560:12345-0@lo:502:llog_process_th.0 Request processed in 225us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.772585:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788845357.772670:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8484:1875740189554560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.772709:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8484:1875740189554688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.772750:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.772771:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.772786:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189554688 00000100:00100000:0.0:1788845357.772790:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189554688 00000100:00100000:0.0:1788845357.772817:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788845357.772822:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:8484:x1875740189554688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845357.772981:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:8484:x1875740189554688:12345-0@lo:502:llog_process_th.0 Request processed in 158us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.773128:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8484:1875740189554688:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788845357.773148:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:0.0:1788845357.773253:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000020:01000000:0.0:1788845357.773284:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788845357.773304:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845357.773315:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.773328:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845357.773340:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788845357.773343:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788845357.773346:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788845357.773404:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.773413:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.773423:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845357.773437:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189554816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.773481:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845357.773506:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae916a6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.773558:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189554816 00000100:00100000:2.0:1788845357.773563:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189554816 00000100:00100000:2.0:1788845357.773589:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788845357.773594:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+13:5814:x1875740189554816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845357.773602:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845357.773613:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae81481600/0xd8041b54d6df97a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df979d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.773632:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81481600/0xd8041b54d6df97a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df979d expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.773640:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae81481600/0xd8041b54d6df97a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df979d expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.773647:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae81481600, rc 0) 00000100:00100000:2.0:1788845357.773677:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189554816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.773684:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788845357.773706:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189554816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845357.773719:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.773735:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845357.774091:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189554944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.774118:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845357.774133:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae916a6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.774145:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189554944 00000100:00100000:0.0:1788845357.774148:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189554944 00000100:00100000:0.0:1788845357.774168:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788845357.774173:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189554944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.774745:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189554944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 499us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.774754:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788845357.774804:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189554944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.774839:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189555072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.774890:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845357.774920:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae916a6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.774948:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189555072 00000100:00100000:0.0:1788845357.774952:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189555072 00000100:00100000:0.0:1788845357.774973:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788845357.774979:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189555072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.775409:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189555072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 429us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.775416:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788845357.775469:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189555072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.776283:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8486:1875740189555200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845357.776345:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.776403:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189555200 00000100:00100000:2.0:1788845357.776408:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189555200 00000100:00100000:2.0:1788845357.776438:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788845357.776459:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:8486:x1875740189555200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845357.776638:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:8486:x1875740189555200:12345-0@lo:502:llog_process_th.0 Request processed in 192us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.776645:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788845357.776846:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950600 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.776941:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8486:1875740189555200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845357.776968:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845357.776977:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845357.776980:0:8486:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788845357.776986:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788845357.777019:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8486:1875740189555328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845357.777219:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.777249:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950600 going to sleep for 11 seconds 00000100:00100000:3.0:1788845357.777337:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189555328 00000100:00100000:3.0:1788845357.777343:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189555328 00000100:00100000:3.0:1788845357.777405:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788845357.777415:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:8486:x1875740189555328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.777634:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:8486:x1875740189555328:12345-0@lo:502:llog_process_th.0 Request processed in 220us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845357.777642:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788845357.778252:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8486:1875740189555328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845357.778282:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845357.778288:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845357.778290:0:8486:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788845357.778294:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788845357.778352:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788845357.778400:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788845357.778412:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.778424:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845357.778433:0:5814:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788845357.778436:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ae8fcc6800 from 4 10000000:01000000:2.0:1788845357.778439:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845357.778492:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.778502:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.778513:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.778529:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189555456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.778569:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.778599:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98ef9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.778613:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189555456 00000100:00100000:2.0:1788845357.778618:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189555456 00000100:00100000:2.0:1788845357.778648:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788845357.778656:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:5814:x1875740189555456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845357.778668:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845357.778836:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae81480200/0xd8041b54d6df97b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df97ab expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.778873:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae81480200/0xd8041b54d6df97b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df97ab expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.778884:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae81480200/0xd8041b54d6df97b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df97ab expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.778893:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae81480200, rc 0) 00000100:00100000:2.0:1788845357.778926:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189555456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 270us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.779190:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788845357.779242:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189555456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845357.779255:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.779264:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.779313:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189555584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.779340:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.779358:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98ef9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.779458:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189555584 00000100:00100000:2.0:1788845357.779462:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189555584 00000100:00100000:2.0:1788845357.779483:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788845357.779489:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189555584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.780104:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189555584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 434us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.780114:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788845357.780150:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189555584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.780183:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189555712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.780221:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.780237:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae904e83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.780251:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189555712 00000100:00100000:2.0:1788845357.780255:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189555712 00000100:00100000:2.0:1788845357.780279:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788845357.780285:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189555712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.780444:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189555712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.780467:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788845357.781317:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189555712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845357.783122:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8488:1875740189555840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.783498:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.783532:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189555840 00000100:00100000:3.0:1788845357.783540:0:8488:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.783542:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189555840 00000100:00100000:2.0:1788845357.783604:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788845357.783616:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:8488:x1875740189555840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845357.784259:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:8488:x1875740189555840:12345-0@lo:502:llog_process_th.0 Request processed in 644us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.784270:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788845357.785498:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8488:1875740189555840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845357.785541:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845357.785554:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845357.785557:0:8488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788845357.785565:0:8488:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ae8fcc6800 00000020:00000080:0.0:1788845357.785568:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788845357.785671:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8488:1875740189555968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845357.785737:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.785774:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189555968 00000100:00100000:3.0:1788845357.785781:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189555968 00000100:00100000:3.0:1788845357.785826:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788845357.785834:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:8488:x1875740189555968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845357.785935:0:8488:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae916a6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788845357.786061:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:8488:x1875740189555968:12345-0@lo:502:llog_process_th.0 Request processed in 228us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845357.786069:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788845357.786125:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8488:1875740189555968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845357.786248:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845357.786253:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845357.786255:0:8488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788845357.786259:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788845357.786335:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788845357.786358:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845357.786394:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.786418:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845357.786428:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788845357.786432:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ae90de3800 from 39 10000000:01000000:2.0:1788845357.786435:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788845357.786474:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.786484:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.786494:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.786522:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.786560:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845357.786593:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189556096 00000100:00100000:2.0:1788845357.786596:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98ef9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.786599:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189556096 00000100:00100000:0.0:1788845357.786634:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788845357.786643:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:5814:x1875740189556096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845357.786653:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845357.786668:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1e600/0xd8041b54d6df97c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df97b9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.786695:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1e600/0xd8041b54d6df97c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df97b9 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.786709:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1e600/0xd8041b54d6df97c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df97b9 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.786730:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1e600, rc 0) 00000100:00100000:0.0:1788845357.786769:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189556096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.786777:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788845357.787239:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845357.787254:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.787266:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.787315:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.787341:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.787469:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98ef9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.789178:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189556224 00000100:00100000:0.0:1788845357.789193:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189556224 00000100:00100000:0.0:1788845357.789380:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788845357.789392:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189556224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.789822:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189556224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 431us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.789831:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788845357.790159:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.790217:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.790269:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.790307:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98ef9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.790323:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189556352 00000100:00100000:2.0:1788845357.790328:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189556352 00000100:00100000:2.0:1788845357.790358:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788845357.790383:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189556352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.790567:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189556352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.790574:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788845357.790620:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.792182:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8489:1875740189556480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845357.792247:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845357.792294:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae916a6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788845357.793287:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189556480 00000100:00100000:3.0:1788845357.793299:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189556480 00000100:00100000:3.0:1788845357.793355:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788845357.793388:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:8489:x1875740189556480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.793761:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:8489:x1875740189556480:12345-0@lo:502:llog_process_th.0 Request processed in 397us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845357.793770:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788845357.793847:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8489:1875740189556480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.793915:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8489:1875740189556608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.793962:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.794001:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe450c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845357.794431:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189556608 00000100:00100000:3.0:1788845357.794437:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189556608 00000100:00100000:3.0:1788845357.794490:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788845357.794500:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:8489:x1875740189556608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.794807:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:8489:x1875740189556608:12345-0@lo:502:llog_process_th.0 Request processed in 309us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845357.794823:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788845357.794882:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8489:1875740189556608:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788845357.794910:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788845357.796728:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788845357.796759:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788845357.796773:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.796789:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845357.796800:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788845357.796804:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788845357.796807:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788845357.796847:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.796857:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.796868:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.796891:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.796953:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.797815:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae83f5f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845357.799925:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189556736 00000100:00100000:3.0:1788845357.799942:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189556736 00000100:00100000:3.0:1788845357.802293:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788845357.802314:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189556736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845357.802338:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845357.802375:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb748ae00/0xd8041b54d6df97ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df97c7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.802411:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb748ae00/0xd8041b54d6df97ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df97c7 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.802425:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb748ae00/0xd8041b54d6df97ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df97c7 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.802436:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748ae00, rc 0) 00000100:00100000:3.0:1788845357.802550:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189556736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (5596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845357.802557:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788845357.802658:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845357.802681:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.802692:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845357.802778:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.802818:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.803585:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189556864 00000100:00100000:0.0:1788845357.803597:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae916a6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.803602:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189556864 00000100:00100000:2.0:1788845357.803646:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788845357.803656:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189556864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.803998:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189556864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.804014:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788845357.807827:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.808161:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.808244:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845357.808352:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae916a6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.809082:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189556992 00000100:00100000:2.0:1788845357.809092:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189556992 00000100:00100000:2.0:1788845357.809420:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788845357.809433:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189556992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.809705:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189556992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.809713:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788845357.810314:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189556992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845357.811218:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8491:1875740189557120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.811310:0:8491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845357.813309:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189557120 00000100:00100000:0.0:1788845357.813329:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189557120 00000100:00100000:3.0:1788845357.813350:0:8491:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.813515:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788845357.813528:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:8491:x1875740189557120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845357.813857:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:8491:x1875740189557120:12345-0@lo:502:llog_process_th.0 Request processed in 332us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.813866:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788845357.814036:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8491:1875740189557120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845357.814088:0:8491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845357.814115:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845357.814118:0:8491:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788845357.814128:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788845357.814174:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8491:1875740189557248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.814243:0:8491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.814277:0:8491:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845357.814301:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189557248 00000100:00100000:2.0:1788845357.814309:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189557248 00000100:00100000:2.0:1788845357.814351:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788845357.814466:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:8491:x1875740189557248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845357.814639:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:8491:x1875740189557248:12345-0@lo:502:llog_process_th.0 Request processed in 279us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.814645:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788845357.814789:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8491:1875740189557248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845357.814822:0:8491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845357.814829:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845357.814831:0:8491:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788845357.814837:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788845357.815015:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788845357.815037:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788845357.815048:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.815060:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845357.815070:0:5814:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788845357.815073:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ae90de3800 from 4 10000000:01000000:2.0:1788845357.815076:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845357.815108:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.815124:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845357.815136:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845357.815158:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189557376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.815209:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.815241:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.815321:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189557376 00000100:00100000:0.0:1788845357.815327:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189557376 00000100:00100000:0.0:1788845357.815438:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788845357.815457:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189557376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845357.815468:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845357.815483:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df97dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df97d5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.815508:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df97dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df97d5 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.815532:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df97dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df97d5 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.815548:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1fc00, rc 0) 00000100:00100000:0.0:1788845357.815592:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189557376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.815599:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788845357.815656:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189557376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845357.815688:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845357.815701:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845357.815912:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189557504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845357.815956:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.816088:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189557504 00000100:00100000:2.0:1788845357.816096:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189557504 00000100:00100000:3.0:1788845357.816118:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845357.816278:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788845357.816289:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189557504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845357.816670:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189557504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845357.816687:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788845357.816694:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189557504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.816749:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189557632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.816806:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.816889:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845357.816942:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189557632 00000100:00100000:1.0:1788845357.816950:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189557632 00000100:00100000:1.0:1788845357.817025:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788845357.817034:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189557632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845357.817221:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189557632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845357.817229:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788845357.817308:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189557632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845357.817595:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8492:1875740189557760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845357.817636:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845357.818098:0:8492:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98ef90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845357.818133:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189557760 00000100:00100000:3.0:1788845357.818139:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189557760 00000100:00100000:3.0:1788845357.818168:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788845357.818176:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:8492:x1875740189557760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.818352:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:8492:x1875740189557760:12345-0@lo:502:llog_process_th.0 Request processed in 177us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845357.818486:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8492:1875740189557760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845357.818515:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845357.818525:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845357.818527:0:8492:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788845357.818534:0:8492:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ae90de3800 00000020:00000080:2.0:1788845357.818537:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788845357.818705:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788845357.820714:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8492:1875740189557888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845357.820823:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845357.821677:0:8492:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845357.823182:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189557888 00000100:00100000:1.0:1788845357.823274:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189557888 00000100:00100000:1.0:1788845357.823484:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788845357.823497:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:8492:x1875740189557888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845357.824042:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:8492:x1875740189557888:12345-0@lo:502:llog_process_th.0 Request processed in 547us (3221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845357.824052:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788845357.824267:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:8492:1875740189557888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788845357.824393:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845357.824479:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845357.824483:0:8492:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788845357.824489:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788845357.825704:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788845357.825894:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845357.825907:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.825980:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845357.826110:0:5814:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788845357.826114:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92ae8ff0cd28 from 1 10000000:01000000:1.0:1788845357.826118:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788845357.826158:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a53a00/0xd8041b54d6df97e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845357.826169:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae89a53a00/0xd8041b54d6df97e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845357.826206:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae89a53a00/0xd8041b54d6df97e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845357.826232:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc785180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189558016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845357.826316:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845357.826391:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.826683:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189558016 00000100:00100000:0.0:1788845357.826691:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189558016 00000100:00100000:0.0:1788845357.826751:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788845357.826760:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189558016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845357.826774:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845357.826789:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1e400/0xd8041b54d6df97ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df97e3 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.827483:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1e400/0xd8041b54d6df97ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df97e3 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.827498:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1e400/0xd8041b54d6df97ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df97e3 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.827524:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1e400, rc 0) 00000100:00100000:0.0:1788845357.827586:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189558016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 827us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845357.827604:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788845357.828104:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc785180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189558016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845357.828126:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae89a53a00/0xd8041b54d6df97e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97ea expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845357.828137:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae89a53a00/0xd8041b54d6df97e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df97ea expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845357.828223:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc785180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189558144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845357.828259:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845357.828304:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845357.828677:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189558144 00000100:00100000:0.0:1788845357.828683:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189558144 00000100:00100000:0.0:1788845357.828720:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788845357.828988:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189558144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845357.829248:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189558144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 520us (987us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788845357.829258:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788845357.829277:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc785180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189558144:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788845357.829321:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788845357.829329:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a53a00/0xd8041b54d6df97e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97ea expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845357.829338:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae89a53a00/0xd8041b54d6df97e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97ea expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845357.916788:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845358.683944:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845358.684024:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180092160 00000100:00100000:0.0:1788845358.684037:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180092160 00000100:00100000:0.0:1788845358.684102:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 184 00000100:00100000:0.0:1788845358.684114:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+9:5614:x1875740180092160:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845358.684136:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845358.684156:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1f600/0xd8041b54d6df97f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce12007752258 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845358.684189:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1f600/0xd8041b54d6df97f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752258 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845358.684200:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1f600/0xd8041b54d6df97f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752258 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845358.684221:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f600, rc 0) 00000100:00100000:0.0:1788845358.684290:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+10:5614:x1875740180092160:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 178us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845358.684297:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 184 00000100:00100000:0.0:1788845358.689326:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845358.689420:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180092288 00000100:00100000:3.0:1788845358.689432:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180092288 00000100:00100000:3.0:1788845358.689511:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 185 00000100:00100000:3.0:1788845358.689528:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:5614:x1875740180092288:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845358.692255:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:5614:x1875740180092288:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 2722us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845358.692269:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 185 00000100:00100000:0.0:1788845358.694428:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845358.696018:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180092416 00000100:00100000:3.0:1788845358.696034:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180092416 00000100:00100000:3.0:1788845358.696098:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 186 00000100:00100000:3.0:1788845358.696110:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+10:5614:x1875740180092416:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845358.696395:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+10:5614:x1875740180092416:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 286us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845358.696404:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 186 00000100:00100000:0.0:1788845358.702990:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845358.703512:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180092544 00000100:00100000:3.0:1788845358.703527:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180092544 00000100:00100000:3.0:1788845358.703958:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 187 00000100:00100000:3.0:1788845358.703972:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:6144:x1875740180092544:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788845358.704559:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:6144:x1875740180092544:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 589us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845358.704569:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 187 00000100:00100000:0.0:1788845358.713993:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845358.714092:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180092672 00000100:00100000:3.0:1788845358.715258:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180092672 00000100:00100000:2.0:1788845358.715759:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 188 00000100:00100000:2.0:1788845358.715771:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:6144:x1875740180092672:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845358.716041:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:6144:x1875740180092672:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 272us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845358.716050:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 188 00000100:00100000:2.0:1788845358.810613:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845358.810654:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845358.810693:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845358.810792:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180092800 00000100:00100000:1.0:1788845358.810801:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180092928 00000100:00100000:3.0:1788845358.810806:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180092800 00000100:00100000:1.0:1788845358.810806:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180092928 00000100:00100000:0.0:1788845358.810879:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180093056 00000100:00100000:0.0:1788845358.810884:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180093056 00000100:00100000:3.0:1788845358.810958:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:3.0:1788845358.810976:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180092800:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845358.811066:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180092800:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 92us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845358.811074:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:1.0:1788845358.817500:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:1.0:1788845358.817523:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180092928:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845358.817640:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180092928:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 126us (7041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845358.817650:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:0.0:1788845358.819955:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:0.0:1788845358.819974:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180093056:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845358.820061:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180093056:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 93us (9366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845358.820068:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00080000:2.0:1788845358.820714:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845358.820722:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788845358.820726:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788845358.940312:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845359.195950:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189558272:0@lo:400:kworker.0 00000100:00100000:2.0:1788845359.195987:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189558400:0@lo:400:kworker.0 00000100:00100000:0.0:1788845359.197489:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189558528:0@lo:400:kworker.0 00000100:00100000:1.0:1788845359.200007:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845359.200027:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845359.200088:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845359.200239:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189558272 00000100:00100000:3.0:1788845359.200248:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189558272 00000100:00100000:1.0:1788845359.200332:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189558784:0@lo:400:kworker.0 00000100:00100000:1.0:1788845359.200397:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845359.200557:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189558400 00000100:00100000:0.0:1788845359.200561:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189558528 00000100:00100000:2.0:1788845359.200568:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189558400 00000100:00100000:0.0:1788845359.200572:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189558528 00000100:00100000:1.0:1788845359.200600:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189558784 00000100:00100000:2.0:1788845359.200654:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788845359.200666:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189558400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845359.200703:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845359.200717:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189558528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845359.200749:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189558400:12345-0@lo:400:kworker.0 Request processed in 84us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845359.200758:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788845359.200793:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189558656:0@lo:400:kworker.0 00000100:00100000:1.0:1788845359.200831:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189558784 00000100:00100000:2.0:1788845359.201201:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845359.201245:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189558528:12345-0@lo:400:kworker.0 Request processed in 531us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845359.201255:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845359.201290:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788845359.201298:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189558784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845359.201550:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189558656 00000100:00100000:1.0:1788845359.201557:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189558656 00000100:00100000:0.0:1788845359.201564:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189558784:12345-0@lo:400:kworker.0 Request processed in 262us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845359.201577:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788845359.201610:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788845359.201616:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845359.201733:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788845359.201744:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3285:x1875740189558272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845359.201752:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845359.201767:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189558656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845359.201802:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845359.201816:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189559040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845359.201819:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189558656:12345-0@lo:400:kworker.0 Request processed in 56us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845359.201828:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788845359.201869:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189558400:0@lo:400:kworker.0 00000100:00100000:2.0:1788845359.201879:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189558912:0@lo:400:kworker.0 00000100:00100000:1.0:1788845359.201987:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189558528:0@lo:400:kworker.0 00000100:00100000:3.0:1788845359.202036:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3285:x1875740189558272:12345-0@lo:400:kworker.0 Request processed in 284us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845359.202037:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845359.202044:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189558784:0@lo:400:kworker.0 00000100:00100000:3.0:1788845359.202059:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788845359.202074:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189558272:0@lo:400:kworker.0 00000100:00100000:1.0:1788845359.202640:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189558912 00000100:00100000:1.0:1788845359.202647:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189558912 00000100:00100000:1.0:1788845359.202690:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845359.202704:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189558912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845359.202938:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189558912:12345-0@lo:400:kworker.0 Request processed in 239us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845359.202945:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788845359.202966:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788845359.202999:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebbccf100 x1875740189558912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845359.203012:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189558912:0@lo:400:kworker.0 00000100:00100000:0.0:1788845359.203528:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845359.203562:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189559040 00000100:00100000:1.0:1788845359.203570:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189559040 00010000:00080000:0.0:1788845359.203578:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb7e2ad80 x1875740189558656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845359.203606:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788845359.203628:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189559040:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845359.203653:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189558656:0@lo:400:kworker.0 00002000:00000024:1.0:1788845359.203660:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845359.203720:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189559040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845359.203726:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788845359.204111:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae90c40a80 x1875740189559040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845359.204129:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189559040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845359.710865:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845359.710892:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189559168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845359.710974:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845359.711154:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189559168 00000100:00100000:1.0:1788845359.711166:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189559168 00000100:00100000:1.0:1788845359.711239:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788845359.711251:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189559168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845359.711293:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845359.711677:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189559168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 428us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845359.711685:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788845359.713205:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc784e00 x1875740189559168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845359.713237:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189559168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788845359.965702:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845360.987555:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845362.015953:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845363.038775:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788845363.644344:0:8773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1788845363.934231:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845363.934273:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845363.934313:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845363.934339:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845363.934387:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180093184 00000100:00100000:1.0:1788845363.934396:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180093184 00000100:00100000:1.0:1788845363.934458:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 190 00000100:00100000:1.0:1788845363.934468:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+10:2374:x1875740180093184:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845363.934538:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+10:2374:x1875740180093184:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 72us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845363.934547:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 190 00000100:00100000:1.0:1788845363.934581:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180093440 00000100:00100000:1.0:1788845363.934585:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180093440 00000100:00100000:1.0:1788845363.934621:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180093568 00000100:00100000:1.0:1788845363.934624:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180093568 00000100:00100000:1.0:1788845363.934642:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:1.0:1788845363.934648:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180093440:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845363.934678:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180093440:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 30us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845363.934685:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:1.0:1788845363.934696:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1788845363.934703:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180093568:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845363.934726:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180093568:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845363.934732:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1788845363.934749:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180093312 00000100:00100000:1.0:1788845363.934752:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180093312 00000100:00100000:1.0:1788845363.934800:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:1.0:1788845363.934815:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180093312:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845363.934844:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180093312:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 31us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845363.934851:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00080000:1.0:1788845363.934995:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788845363.935000:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845363.935002:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788845364.065619:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845364.317070:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189559296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845364.317155:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845364.317469:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189559552:0@lo:400:kworker.0 00000100:00100000:2.0:1788845364.317497:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189559296 00000100:00100000:0.0:1788845364.317503:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845364.317507:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189559296 00000100:00100000:0.0:1788845364.317526:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845364.317531:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189559680:0@lo:400:kworker.0 00000100:00100000:0.0:1788845364.317552:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845364.317583:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788845364.317594:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189559296:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845364.317594:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189559552 00000100:00100000:0.0:1788845364.317598:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189559552 00000100:00100000:0.0:1788845364.317624:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189559680 00000100:00100000:0.0:1788845364.317626:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189559680 00002000:00000024:2.0:1788845364.317647:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845364.317697:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189559296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845364.317706:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788845364.317734:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845364.317739:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845364.317741:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788845364.317747:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189559552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845364.317755:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788845364.317761:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189559680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845364.317789:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189559680:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845364.317789:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189559552:12345-0@lo:400:kworker.0 Request processed in 41us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845364.317795:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788845364.317845:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189559424:0@lo:400:kworker.0 00000100:00100000:0.0:1788845364.317845:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189559680:0@lo:400:kworker.0 00000100:00100000:0.0:1788845364.317857:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189559552:0@lo:400:kworker.0 00000100:00100000:1.0:1788845364.317879:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845364.317900:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189559808:0@lo:400:kworker.0 00000100:00100000:1.0:1788845364.317906:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189559936:0@lo:400:kworker.0 00000100:00100000:0.0:1788845364.317923:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845364.317925:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788845364.317949:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae90c43b80 x1875740189559296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845364.317950:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189559808 00000100:00100000:0.0:1788845364.317965:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189559296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845364.317966:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189559808 00000100:00100000:0.0:1788845364.317987:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189559424 00000100:00100000:0.0:1788845364.317990:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189559424 00000100:00100000:0.0:1788845364.318014:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788845364.318021:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189559424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845364.318057:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189559424:12345-0@lo:400:kworker.0 Request processed in 36us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845364.318063:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788845364.318101:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189559936 00000100:00100000:0.0:1788845364.318104:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189559936 00000100:00100000:0.0:1788845364.318131:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788845364.318138:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189559936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845364.318170:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189559936:12345-0@lo:400:kworker.0 Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845364.318183:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788845364.318216:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189559424:0@lo:400:kworker.0 00010000:00080000:0.0:1788845364.318226:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae9eac0000 x1875740189559936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845364.318235:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189559936:0@lo:400:kworker.0 00000100:00100000:2.0:1788845364.319771:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788845364.319820:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845364.319826:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845364.320100:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788845364.320118:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189559808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845364.320213:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189559808:12345-0@lo:400:kworker.0 Request processed in 105us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845364.320220:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788845364.320359:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189559808:0@lo:400:kworker.0 00000100:00100000:3.0:1788845364.835766:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845364.839146:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189560064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845364.839229:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845364.839593:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189560064 00000100:00100000:3.0:1788845364.839602:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189560064 00000100:00100000:3.0:1788845364.839658:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788845364.839667:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189560064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845364.839720:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845364.839779:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189560064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845364.839786:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788845364.839858:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb74abb80 x1875740189560064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845364.839890:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189560064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788845365.084784:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845366.108000:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845367.134692:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845368.158749:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788845368.163464:0:9017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing yml_node 00000100:00100000:3.0:1788845369.055913:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845369.056114:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845369.056218:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845369.056311:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845369.056345:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180093952 00000100:00100000:3.0:1788845369.056354:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180093952 00000100:00100000:3.0:1788845369.056453:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180094080 00000100:00100000:3.0:1788845369.056457:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180094080 00000100:00100000:3.0:1788845369.056476:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:3.0:1788845369.056487:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180093952:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845369.056555:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180093952:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 70us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845369.056563:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:3.0:1788845369.056579:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:3.0:1788845369.056585:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2375:x1875740180094080:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845369.056610:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2375:x1875740180094080:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845369.056617:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:0.0:1788845369.056875:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180093824 00000100:00100000:0.0:1788845369.056889:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180093824 00000100:00100000:0.0:1788845369.056930:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:0.0:1788845369.056938:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180093824:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845369.056989:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180093824:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 52us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845369.056995:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:2.0:1788845369.058345:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180093696 00000100:00100000:2.0:1788845369.058353:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180093696 00000100:00080000:3.0:1788845369.058417:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788845369.058422:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845369.058425:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845369.060235:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 192 00000100:00100000:2.0:1788845369.060255:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:2374:x1875740180093696:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845369.060341:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:2374:x1875740180093696:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 88us (4227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845369.060348:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 192 00010000:00010000:0.0:1788845369.180569:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845369.437419:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189560192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845369.437503:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845369.438000:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189560192 00000100:00100000:2.0:1788845369.438011:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189560192 00000100:00080000:3.0:1788845369.438113:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845369.438157:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788845369.438170:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189560192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845369.438212:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845369.438274:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189560192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845369.438282:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788845369.438443:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae90c42a00 x1875740189560192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845369.438467:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189560192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845369.439864:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189560576:0@lo:400:kworker.0 00000100:00100000:1.0:1788845369.439928:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845369.439969:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845369.439995:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189560704:0@lo:400:kworker.0 00000100:00100000:1.0:1788845369.440028:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845369.440068:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189560576 00000100:00100000:1.0:1788845369.440075:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189560576 00000100:00100000:3.0:1788845369.440120:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189560704 00000100:00100000:3.0:1788845369.440126:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189560704 00000100:00100000:1.0:1788845369.440148:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788845369.440158:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189560576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845369.440206:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189560576:12345-0@lo:400:kworker.0 Request processed in 48us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845369.440217:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189560320:0@lo:400:kworker.0 00000100:00100000:2.0:1788845369.440264:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189560448:0@lo:400:kworker.0 00000100:00100000:2.0:1788845369.440300:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845369.440339:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189560448 00000100:00100000:2.0:1788845369.440343:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189560448 00000100:00100000:0.0:1788845369.441142:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845369.441180:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189560832:0@lo:400:kworker.0 00000100:00100000:0.0:1788845369.441205:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845369.441240:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189560320 00000100:00100000:0.0:1788845369.441245:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189560320 00000100:00100000:0.0:1788845369.441275:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788845369.441283:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3285:x1875740189560320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845369.441320:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3285:x1875740189560320:12345-0@lo:400:kworker.0 Request processed in 38us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845369.441327:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788845369.441357:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189560832 00000100:00100000:0.0:1788845369.441375:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189560832 00000100:00100000:0.0:1788845369.441415:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788845369.441422:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189560832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845369.441453:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189560832:12345-0@lo:400:kworker.0 Request processed in 32us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845369.441460:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788845369.441498:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189560320:0@lo:400:kworker.0 00010000:00080000:0.0:1788845369.441518:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc784380 x1875740189560832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845369.441530:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189560832:0@lo:400:kworker.0 00000100:00080000:0.0:1788845369.442456:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845369.442464:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845369.443304:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788845369.443329:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189560704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845369.443476:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189560704:12345-0@lo:400:kworker.0 Request processed in 162us (3457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845369.443484:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788845369.446092:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189560704:0@lo:400:kworker.0 00000100:00100000:0.0:1788845369.446119:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189560576:0@lo:400:kworker.0 00000100:00100000:1.0:1788845369.446839:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788845369.448568:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845369.448592:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189560448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845369.448717:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189560448:12345-0@lo:400:kworker.0 Request processed in 137us (8416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845369.448726:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788845369.448842:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189560448:0@lo:400:kworker.0 00000100:00100000:0.0:1788845369.947770:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845369.947798:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189560960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845369.947873:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845369.948030:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189560960 00000100:00100000:3.0:1788845369.948038:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189560960 00000100:00100000:3.0:1788845369.948088:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788845369.948096:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189560960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845369.948130:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845369.948184:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189560960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845369.948191:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788845369.948418:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb74ab480 x1875740189560960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845369.948437:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189560960:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788845370.208347:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845371.231131:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788845371.593975:0:9208:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.108 00010000:00010000:2.0:1788845372.251642:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845373.275532:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788845373.936772:0:9305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.108 00000100:00100000:3.0:1788845374.171542:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845374.171595:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845374.171682:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180094208 00000100:00100000:2.0:1788845374.171693:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180094208 00000100:00100000:0.0:1788845374.171696:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180094336 00000100:00100000:0.0:1788845374.171704:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180094336 00000100:00100000:0.0:1788845374.171764:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:0.0:1788845374.171776:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180094336:12345-192.168.206.35@tcp:400:kworker.0 00000100:00080000:3.0:1788845374.171811:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845374.171858:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 194 00000100:00100000:0.0:1788845374.171860:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180094336:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845374.171872:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:2374:x1875740180094208:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845374.171872:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:2.0:1788845374.171909:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:2374:x1875740180094208:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 42us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845374.171916:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 194 00000100:00100000:3.0:1788845374.176507:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845374.176617:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180094464 00000100:00100000:0.0:1788845374.176627:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180094464 00000100:00100000:0.0:1788845374.176739:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:0.0:1788845374.176751:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+5:2371:x1875740180094464:12345-192.168.206.35@tcp:9:kworker.0 00000020:00000080:0.0:1788845374.176789:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df972d 00000100:00080000:0.0:1788845374.176800:0:6659:0:(import.c:65:import_set_state_nolock()) ffff92aeb7592000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788845374.176842:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788845374.177243:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+2:2371:x1875740180094464:12345-192.168.206.35@tcp:9:kworker.0 Request processed in 493us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845374.177251:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00010000:00010000:2.0:1788845374.177504:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788845374.177769:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845374.178272:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845374.178330:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180094592 00000100:00100000:1.0:1788845374.178338:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180094592 00000100:00100000:1.0:1788845374.178425:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1788845374.178435:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2371:x1875740180094592:12345-192.168.206.35@tcp:9:kworker.0 00000020:00000080:1.0:1788845374.178467:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9734 00000100:00080000:1.0:1788845374.178476:0:6656:0:(import.c:65:import_set_state_nolock()) ffff92aeb7596800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788845374.178508:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788845374.178597:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788845374.178604:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845374.180682:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+2:2371:x1875740180094592:12345-192.168.206.35@tcp:9:kworker.0 Request processed in 2236us (2403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845374.180694:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00010000:00010000:1.0:1788845374.299586:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845374.555669:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189561088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845374.555764:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845374.555885:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189561088 00000100:00100000:2.0:1788845374.555893:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189561088 00000100:00100000:2.0:1788845374.555961:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788845374.555971:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189561088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845374.556006:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845374.556051:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189561088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845374.556058:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788845374.556192:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788845374.556221:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae90c41880 x1875740189561088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845374.556241:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189561088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845374.561845:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189561472:0@lo:400:kworker.0 00000100:00100000:2.0:1788845374.561918:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845374.561956:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845374.561961:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189561344:0@lo:400:kworker.0 00000100:00100000:2.0:1788845374.561980:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845374.562003:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189561472 00000100:00100000:2.0:1788845374.562009:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189561472 00000100:00100000:2.0:1788845374.562067:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189561344 00000100:00100000:2.0:1788845374.562070:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189561344 00000100:00100000:2.0:1788845374.562084:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788845374.562091:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189561472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845374.562133:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189561472:12345-0@lo:400:kworker.0 Request processed in 43us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845374.562141:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788845374.562156:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788845374.562162:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189561344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845374.562182:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189561344:12345-0@lo:400:kworker.0 Request processed in 20us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845374.562200:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788845374.562231:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189561344:0@lo:400:kworker.0 00000100:00100000:2.0:1788845374.562240:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189561472:0@lo:400:kworker.0 00000100:00080000:0.0:1788845374.562305:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845374.562317:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189561600:0@lo:400:kworker.0 00000100:00100000:0.0:1788845374.562346:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845374.562409:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788845374.562416:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189561216:0@lo:400:kworker.0 00000100:00100000:0.0:1788845374.562442:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845374.562459:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189561600 00000100:00100000:3.0:1788845374.562464:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189561600 00000100:00100000:0.0:1788845374.562464:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189561728:0@lo:400:kworker.0 00000100:00100000:0.0:1788845374.562486:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845374.562501:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788845374.562508:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189561600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845374.562517:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189561216 00000100:00100000:0.0:1788845374.562520:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189561216 00000100:00100000:0.0:1788845374.562544:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788845374.562545:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189561600:12345-0@lo:400:kworker.0 Request processed in 37us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845374.562550:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189561216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845374.562551:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788845374.562571:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845374.562580:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189561216:12345-0@lo:400:kworker.0 Request processed in 30us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845374.562585:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189561216:0@lo:400:kworker.0 00000100:00100000:0.0:1788845374.562586:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788845374.562594:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189561600:0@lo:400:kworker.0 00000100:00100000:0.0:1788845374.562612:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189561728 00000100:00100000:0.0:1788845374.562615:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189561728 00000100:00080000:3.0:1788845374.562632:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845374.562640:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788845374.562646:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189561728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845374.562687:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189561728:12345-0@lo:400:kworker.0 Request processed in 41us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845374.562700:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788845374.562714:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae90c43100 x1875740189561728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845374.562725:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189561728:0@lo:400:kworker.0 00000100:00100000:2.0:1788845375.071517:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845375.071993:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189561856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845375.072126:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845375.072717:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189561856 00000100:00100000:3.0:1788845375.072725:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189561856 00000100:00100000:3.0:1788845375.072818:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788845375.072828:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189561856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845375.072878:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845375.072975:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189561856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845375.072982:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788845375.073259:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb74aaa00 x1875740189561856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845375.073281:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189561856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788845375.328715:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788845375.635499:0:6682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00000020:00000080:2.0:1788845375.635509:0:6682:0:(genops.c:885:class_export_put()) final put ffff92aeb7594800/704fd1fa-8fb6-403c-867f-b875231088ec 00000020:00000080:3.0:1788845375.639471:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb7594800/704fd1fa-8fb6-403c-867f-b875231088ec for lustre-OST0000 00000020:00000080:3.0:1788845375.639536:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aeb7592000 for lustre-OST0000 00000001:02000400:1.0:1788845375.930722:0:9404:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.108 00010000:00010000:2.0:1788845376.347637:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788845377.211552:0:9452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 01:29:35 EDT 2026 00010000:00010000:3.0:1788845377.371569:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845378.398675:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788845378.737568:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00000020:00000080:2.0:1788845378.737578:0:7612:0:(genops.c:885:class_export_put()) final put ffff92aeb7594000/704fd1fa-8fb6-403c-867f-b875231088ec 00000020:00000080:1.0:1788845378.737645:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb7594000/704fd1fa-8fb6-403c-867f-b875231088ec for lustre-OST0001 00000020:00000080:1.0:1788845378.737697:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aeb7596800 for lustre-OST0001 00000100:00100000:3.0:1788845379.291547:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845379.291608:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845379.291795:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180094848 00000100:00100000:0.0:1788845379.291805:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180094848 00000100:00100000:0.0:1788845379.291877:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:0.0:1788845379.291887:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180094848:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845379.291956:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180094848:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 70us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845379.291963:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00080000:0.0:1788845379.291986:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845379.292218:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180094720 00000100:00100000:1.0:1788845379.292223:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180094720 00000100:00100000:1.0:1788845379.292270:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 196 00000100:00100000:1.0:1788845379.292277:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:2375:x1875740180094720:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845379.292315:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+10:2375:x1875740180094720:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 38us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845379.292322:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 196 00010000:00010000:1.0:1788845379.419591:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845379.675634:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845379.675658:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189561984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845379.675731:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845379.675805:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189561984 00000100:00100000:2.0:1788845379.675812:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189561984 00000100:00100000:2.0:1788845379.675869:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845379.675879:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189561984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845379.675912:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845379.675955:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189561984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845379.675962:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788845379.676003:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae90c41500 x1875740189561984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845379.676045:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189561984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845379.676201:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189562496:0@lo:400:kworker.0 00000100:00100000:0.0:1788845379.676237:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845379.676260:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845379.676266:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189562368:0@lo:400:kworker.0 00000100:00100000:0.0:1788845379.676289:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788845379.676311:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845379.676322:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189562240:0@lo:400:kworker.0 00000100:00100000:0.0:1788845379.676358:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845379.676436:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189562112:0@lo:400:kworker.0 00000100:00100000:2.0:1788845379.676469:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845379.676494:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189562624:0@lo:400:kworker.0 00000100:00100000:2.0:1788845379.676516:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845379.676545:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189562624 00000100:00100000:2.0:1788845379.676549:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189562624 00000100:00100000:2.0:1788845379.676583:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788845379.676590:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189562624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845379.676627:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189562624:12345-0@lo:400:kworker.0 Request processed in 38us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845379.676633:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788845379.676660:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae9eac0700 x1875740189562624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845379.676669:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189562624:0@lo:400:kworker.0 00000100:00100000:0.0:1788845379.678586:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189562496 00000100:00100000:0.0:1788845379.678595:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189562496 00000100:00100000:0.0:1788845379.678641:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189562368 00000100:00100000:0.0:1788845379.678644:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189562368 00000100:00100000:0.0:1788845379.678675:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189562240 00000100:00100000:0.0:1788845379.678678:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189562240 00000100:00100000:0.0:1788845379.678695:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788845379.678704:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875740189562496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845379.678768:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875740189562496:12345-0@lo:400:kworker.0 Request processed in 66us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845379.678774:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788845379.678790:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788845379.678796:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189562368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845379.678823:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189562368:12345-0@lo:400:kworker.0 Request processed in 27us (2534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845379.678828:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788845379.678839:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788845379.678844:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189562240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845379.678875:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189562240:12345-0@lo:400:kworker.0 Request processed in 31us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845379.678880:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788845379.678901:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189562112 00000100:00100000:0.0:1788845379.678905:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189562112 00000100:00100000:0.0:1788845379.678931:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788845379.678937:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189562112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845379.678974:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189562112:12345-0@lo:400:kworker.0 Request processed in 38us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845379.678979:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1788845379.679016:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845379.679021:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845379.679050:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189562368:0@lo:400:kworker.0 00000100:00100000:0.0:1788845379.679074:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189562496:0@lo:400:kworker.0 00000100:00100000:0.0:1788845379.679109:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189562112:0@lo:400:kworker.0 00000100:00100000:0.0:1788845379.679132:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189562240:0@lo:400:kworker.0 00000100:00100000:2.0:1788845380.187761:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845380.187948:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189562752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845380.188023:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845380.188530:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189562752 00000100:00100000:0.0:1788845380.188540:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189562752 00000100:00100000:0.0:1788845380.188607:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788845380.188616:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189562752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845380.188651:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845380.188706:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189562752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845380.188713:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788845380.189040:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb74a9880 x1875740189562752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845380.189077:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189562752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788845380.443905:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845381.467633:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845382.491681:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845383.522321:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845384.413593:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845384.413665:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845384.413699:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180095104 00000100:00100000:3.0:1788845384.413709:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180095104 00000100:00100000:3.0:1788845384.413774:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:3.0:1788845384.413784:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180095104:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845384.413855:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180095104:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845384.413862:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:3.0:1788845384.413885:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180094976 00000100:00100000:3.0:1788845384.413889:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180094976 00000100:00100000:3.0:1788845384.413910:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 198 00000100:00100000:3.0:1788845384.413917:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:2375:x1875740180094976:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845384.413943:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+10:2375:x1875740180094976:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845384.413949:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 198 00000100:00080000:3.0:1788845384.413973:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788845384.539847:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845384.795526:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189562880:0@lo:400:kworker.0 00000100:00100000:1.0:1788845384.795601:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845384.795667:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189562880 00000100:00100000:3.0:1788845384.795675:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189562880 00000100:00100000:3.0:1788845384.795728:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788845384.795738:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3285:x1875740189562880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845384.796806:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3285:x1875740189562880:12345-0@lo:400:kworker.0 Request processed in 1065us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845384.796827:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788845384.796952:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189563136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845384.796999:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845384.797045:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189563136 00000100:00100000:3.0:1788845384.797051:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189563136 00000100:00100000:3.0:1788845384.797109:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788845384.797117:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189563136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788845384.797148:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845384.797186:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189563136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845384.797192:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788845384.797207:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845384.797234:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb74a8380 x1875740189563136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845384.797251:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189563136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845384.797288:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189563008:0@lo:400:kworker.0 00000100:00100000:3.0:1788845384.797328:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845384.797382:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189563008 00000100:00100000:3.0:1788845384.797386:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189563008 00000100:00100000:3.0:1788845384.797413:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788845384.797419:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189563008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845384.797634:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875740189563264:0@lo:400:kworker.0 00000100:00100000:0.0:1788845384.797677:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845384.797707:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189563264 00000100:00100000:0.0:1788845384.797711:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189563264 00000100:00100000:0.0:1788845384.797741:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788845384.797748:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875740189563264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845384.797786:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875740189563264:12345-0@lo:400:kworker.0 Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845384.797792:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788845384.797819:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875740189563264:0@lo:400:kworker.0 00000100:00080000:0.0:1788845384.797832:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845384.798429:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189563392:0@lo:400:kworker.0 00000100:00100000:1.0:1788845384.798472:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845384.798520:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189562880:0@lo:400:kworker.0 00000100:00100000:1.0:1788845384.798538:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845384.798546:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189563520:0@lo:400:kworker.0 00000100:00100000:1.0:1788845384.798576:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845384.798789:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189563392 00000100:00100000:0.0:1788845384.798794:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189563392 00000100:00100000:0.0:1788845384.798840:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788845384.798848:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189563392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845384.798894:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189563392:12345-0@lo:400:kworker.0 Request processed in 46us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845384.799460:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788845384.799510:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845384.800527:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189563520 00000100:00100000:0.0:1788845384.800537:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189563520 00000100:00100000:0.0:1788845384.800596:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788845384.800626:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189563520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845384.800702:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189563520:12345-0@lo:400:kworker.0 Request processed in 86us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845384.800709:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788845384.800745:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845384.801676:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189563008:12345-0@lo:400:kworker.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845384.801694:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788845384.801758:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189563008:0@lo:400:kworker.0 00010000:00080000:1.0:1788845384.801810:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeae296680 x1875740189563520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845384.801824:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189563520:0@lo:400:kworker.0 00000100:00100000:1.0:1788845384.801839:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189563392:0@lo:400:kworker.0 00000100:00100000:0.0:1788845385.307843:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189563648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845385.307919:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845385.308003:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189563648 00000100:00100000:1.0:1788845385.308011:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189563648 00000100:00100000:1.0:1788845385.308063:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788845385.308075:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189563648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845385.308117:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845385.308168:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189563648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845385.308176:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788845385.308351:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc786300 x1875740189563648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845385.308385:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189563648:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788845385.567595:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845386.587992:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845387.611702:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845388.638970:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788845388.960990:0:10082:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:29:47 (1788845387) === 00000100:00100000:1.0:1788845389.360826:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845389.361071:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180095232 00000100:00100000:3.0:1788845389.361081:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180095232 00000100:00100000:3.0:1788845389.361144:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 200 00000100:00100000:3.0:1788845389.361155:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+10:8137:x1875740180095232:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788845389.361172:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845389.361188:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb748bc00/0xd8041b54d6df97f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce1200775225f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845389.361222:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb748bc00/0xd8041b54d6df97f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775225f expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845389.361234:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb748bc00/0xd8041b54d6df97f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775225f expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845389.361243:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748bc00, rc 0) 00000100:00100000:3.0:1788845389.361316:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+11:8137:x1875740180095232:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 162us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845389.361323:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 200 00000100:00100000:3.0:1788845389.366907:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845389.370072:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180095360 00000100:00100000:0.0:1788845389.370089:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180095360 00000100:00100000:0.0:1788845389.370228:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 201 00000100:00100000:0.0:1788845389.370240:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+11:8137:x1875740180095360:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788845389.370636:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+11:8137:x1875740180095360:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 397us (3741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845389.370644:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 201 00000100:00100000:1.0:1788845389.374110:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845389.374294:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180095488 00000100:00100000:0.0:1788845389.374304:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180095488 00000100:00100000:0.0:1788845389.374400:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 202 00000100:00100000:0.0:1788845389.374411:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+11:8137:x1875740180095488:12345-192.168.206.35@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788845389.374642:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+11:8137:x1875740180095488:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 232us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845389.374650:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 202 00000100:00100000:1.0:1788845389.378127:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845389.378458:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180095616 00000100:00100000:0.0:1788845389.378467:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180095616 00000100:00100000:0.0:1788845389.378528:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 203 00000100:00100000:0.0:1788845389.378538:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+11:8141:x1875740180095616:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788845389.379145:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+11:8141:x1875740180095616:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 606us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845389.379154:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 203 00000100:00100000:1.0:1788845389.390842:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845389.391020:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180095744 00000100:00100000:3.0:1788845389.391031:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180095744 00000100:00100000:3.0:1788845389.391189:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 204 00000100:00100000:3.0:1788845389.391200:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+11:8141:x1875740180095744:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788845389.391530:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+11:8141:x1875740180095744:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 331us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845389.391538:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 204 00000100:00100000:2.0:1788845389.394478:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845389.394583:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180095872 00000100:00100000:0.0:1788845389.394592:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180095872 00000100:00100000:0.0:1788845389.394653:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 205 00000100:00100000:0.0:1788845389.394664:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+11:8137:x1875740180095872:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788845389.394680:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845389.394700:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1f800/0xd8041b54d6df97ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce12007752289 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845389.394729:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1f800/0xd8041b54d6df97ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752289 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845389.394741:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1f800/0xd8041b54d6df97ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752289 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845389.394933:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f800, rc 0) 00000100:00100000:0.0:1788845389.395158:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+12:8137:x1875740180095872:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 495us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845389.395166:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 205 00000100:00100000:1.0:1788845389.403191:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845389.403529:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180096000 00000100:00100000:3.0:1788845389.403540:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180096000 00000100:00100000:3.0:1788845389.403610:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 206 00000100:00100000:3.0:1788845389.403621:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+12:8137:x1875740180096000:12345-192.168.206.35@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788845389.403649:0:5811:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788845389.403689:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788845389.403694:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788845389.403698:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788845389.403700:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788845389.405659:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+12:8137:x1875740180096000:12345-192.168.206.35@tcp:256:mount.lustre.0 Request processed in 2027us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845389.405673:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 206 00000100:00100000:2.0:1788845389.408431:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845389.408740:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180096128 00000100:00100000:0.0:1788845389.408750:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180096128 00000100:00100000:0.0:1788845389.408853:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 207 00000100:00100000:0.0:1788845389.408863:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+12:8137:x1875740180096128:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788845389.408880:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845389.408898:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1f200/0xd8041b54d6df9806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce12007752290 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845389.408927:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1f200/0xd8041b54d6df9806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752290 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845389.408951:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1f200/0xd8041b54d6df9806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752290 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845389.408962:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f200, rc 0) 00000100:00100000:0.0:1788845389.409025:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:8137:x1875740180096128:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 163us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845389.409032:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 207 00000100:00100000:1.0:1788845389.411149:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845389.411697:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180096256 00000100:00100000:3.0:1788845389.411706:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180096256 00000100:00100000:3.0:1788845389.411894:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 208 00000100:00100000:3.0:1788845389.411909:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:8137:x1875740180096256:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788845389.412345:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:8137:x1875740180096256:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 440us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845389.412353:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 208 00000100:00100000:1.0:1788845389.414135:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845389.414233:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180096384 00000100:00100000:0.0:1788845389.414242:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180096384 00000100:00100000:0.0:1788845389.414303:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 209 00000100:00100000:0.0:1788845389.414314:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:8137:x1875740180096384:12345-192.168.206.35@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788845389.414862:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:8137:x1875740180096384:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 539us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845389.414871:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 209 00000100:00100000:2.0:1788845389.418184:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845389.418312:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180096512 00000100:00100000:3.0:1788845389.418322:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180096512 00000100:00100000:3.0:1788845389.418627:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 210 00000100:00100000:3.0:1788845389.418651:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:8145:x1875740180096512:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845389.420116:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:8145:x1875740180096512:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 1470us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845389.420141:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 210 00000100:00100000:1.0:1788845389.423557:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845389.423734:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180096640 00000100:00100000:0.0:1788845389.423745:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180096640 00000100:00100000:0.0:1788845389.423808:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 211 00000100:00100000:0.0:1788845389.423822:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:8145:x1875740180096640:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788845389.424106:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:8145:x1875740180096640:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 288us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845389.424114:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 211 00000100:00100000:1.0:1788845389.430743:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845389.430783:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845389.430872:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180096896 00000100:00100000:0.0:1788845389.430883:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180096896 00000100:00100000:0.0:1788845389.431066:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180096768 00000100:00100000:0.0:1788845389.431070:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180096768 00000100:00100000:0.0:1788845389.431094:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:0.0:1788845389.431103:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180096896:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845389.431171:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180096896:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 69us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845389.431177:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:0.0:1788845389.431194:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:0.0:1788845389.431199:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2371:x1875740180096768:12345-192.168.206.35@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788845389.431489:0:5817:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c53707e2-5013-40b9-a38c-51554aa096c9@192.168.206.35@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1788845389.431524:0:5817:0:(genops.c:1385:class_connect()) connect: client c53707e2-5013-40b9-a38c-51554aa096c9, cookie 0xd8041b54d6df980d 00000004:00100000:0.0:1788845389.431555:0:5817:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788845389.431963:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845389.432928:0:5817:0:(import.c:65:import_set_state_nolock()) ffff92aebca02000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845389.433036:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+6:2371:x1875740180096768:12345-192.168.206.35@tcp:38:mount.lustre.0 Request processed in 1831us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845389.433046:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:1.0:1788845389.438469:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845389.438881:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180097024 00000100:00100000:3.0:1788845389.438890:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180097024 00000100:00100000:3.0:1788845389.438972:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:3.0:1788845389.438982:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c53707e2-5013-40b9-a38c-51554aa096c9+6:0:x1875740180097024:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788845389.439042:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788845389.439199:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c53707e2-5013-40b9-a38c-51554aa096c9+6:0:x1875740180097024:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 217us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845389.439216:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00080000:1.0:1788845389.439651:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845389.441214:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845389.444656:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180097152 00000100:00100000:3.0:1788845389.444676:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180097152 00000100:00100000:3.0:1788845389.444758:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:3.0:1788845389.444768:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+6:8137:x1875740180097152:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788845389.444798:0:8176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788845389.444996:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+6:8137:x1875740180097152:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 228us (3800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845389.445003:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:2.0:1788845389.450544:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845389.450647:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180097280 00000100:00100000:0.0:1788845389.450657:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180097280 00000100:00100000:0.0:1788845389.450716:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:0.0:1788845389.450725:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+6:8137:x1875740180097280:12345-192.168.206.35@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788845389.450802:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+6:8137:x1875740180097280:12345-192.168.206.35@tcp:40:mount.lustre.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845389.450808:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1788845389.453214:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845389.453271:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845389.453337:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180097408 00000100:00100000:1.0:1788845389.453341:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845389.453349:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180097408 00000100:00100000:0.0:1788845389.453425:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180097536 00000100:00100000:0.0:1788845389.453428:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180097536 00000100:00100000:1.0:1788845389.453443:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:1.0:1788845389.453452:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875740180097408:12345-192.168.206.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788845389.453484:0:6656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c53707e2-5013-40b9-a38c-51554aa096c9@192.168.206.35@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1788845389.453516:0:6656:0:(genops.c:1385:class_connect()) connect: client c53707e2-5013-40b9-a38c-51554aa096c9, cookie 0xd8041b54d6df9814 00002000:00100000:1.0:1788845389.453539:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c53707e2-5013-40b9-a38c-51554aa096c9/ffff92aeae469000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1788845389.453645:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180097664 00000100:00100000:3.0:1788845389.453650:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180097664 00000100:00100000:3.0:1788845389.453698:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:3.0:1788845389.453706:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c53707e2-5013-40b9-a38c-51554aa096c9+6:8137:x1875740180097664:12345-192.168.206.35@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788845389.453772:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788845389.453854:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c53707e2-5013-40b9-a38c-51554aa096c9+6:8137:x1875740180097664:12345-192.168.206.35@tcp:33:mount.lustre.0 Request processed in 149us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845389.453862:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00002000:00100000:1.0:1788845389.454262:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788845389.454798:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788845389.454832:0:6656:0:(import.c:65:import_set_state_nolock()) ffff92aeae46d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845389.454951:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+6:2371:x1875740180097408:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 1488us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845389.454959:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:1.0:1788845389.454984:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1788845389.454990:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875740180097536:12345-192.168.206.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788845389.455010:0:6656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c53707e2-5013-40b9-a38c-51554aa096c9@192.168.206.35@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1788845389.455032:0:6656:0:(genops.c:1385:class_connect()) connect: client c53707e2-5013-40b9-a38c-51554aa096c9, cookie 0xd8041b54d6df981b 00002000:00100000:1.0:1788845389.455042:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c53707e2-5013-40b9-a38c-51554aa096c9/ffff92aeae46b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788845389.455058:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788845389.455196:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788845389.455213:0:6656:0:(import.c:65:import_set_state_nolock()) ffff92aeae46e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845389.455238:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+6:2371:x1875740180097536:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 247us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845389.455246:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00010000:00010000:3.0:1788845389.659853:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845389.915697:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189563776:0@lo:400:kworker.0 00000100:00100000:0.0:1788845389.915777:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845389.915811:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845389.915827:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189563904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845389.915864:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845389.915898:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189563904 00000100:00100000:1.0:1788845389.915898:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189563776 00000100:00100000:1.0:1788845389.915907:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189563776 00000100:00100000:1.0:1788845389.915953:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788845389.915962:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189563776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845389.916065:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189563904 00000100:00100000:3.0:1788845389.916101:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788845389.916106:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189563904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788845389.916121:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845389.916153:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189563904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845389.916159:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788845389.916193:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb74a9180 x1875740189563904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845389.916213:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189563904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845389.916228:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189564032:0@lo:400:kworker.0 00000100:00100000:3.0:1788845389.916250:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845389.916287:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189564032 00000100:00100000:3.0:1788845389.916291:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189564032 00000100:00100000:3.0:1788845389.916316:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788845389.916321:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189564032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845389.916350:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189564032:12345-0@lo:400:kworker.0 Request processed in 29us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845389.916356:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788845389.916400:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189564032:0@lo:400:kworker.0 00000100:00080000:3.0:1788845389.916434:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845389.916455:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189564160:0@lo:400:kworker.0 00000100:00100000:3.0:1788845389.916477:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845389.916507:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189564160 00000100:00100000:3.0:1788845389.916510:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189564160 00000100:00100000:3.0:1788845389.916540:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788845389.916545:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189564160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845389.916589:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189564160:12345-0@lo:400:kworker.0 Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845389.916594:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788845389.916607:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845389.916620:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189564160:0@lo:400:kworker.0 00000100:00100000:1.0:1788845389.917270:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189563776:12345-0@lo:400:kworker.0 Request processed in 1308us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845389.917291:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788845389.919641:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189563776:0@lo:400:kworker.0 00000100:00100000:3.0:1788845389.920440:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845389.920521:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845389.920536:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189564416:0@lo:400:kworker.0 00000100:00100000:2.0:1788845389.920603:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845389.920646:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189564416 00000100:00100000:2.0:1788845389.920652:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189564416 00000100:00100000:2.0:1788845389.920707:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845389.920716:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189564416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845389.920770:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189564416:12345-0@lo:400:kworker.0 Request processed in 54us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845389.920777:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788845389.920799:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788845389.920822:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae90c40a80 x1875740189564416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845389.920834:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189564416:0@lo:400:kworker.0 00000100:00100000:3.0:1788845389.921556:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189564288:0@lo:400:kworker.0 00000100:00100000:3.0:1788845389.921603:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845389.921705:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189564288 00000100:00100000:0.0:1788845389.921711:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189564288 00000100:00100000:0.0:1788845389.921799:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788845389.921806:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189564288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845389.921860:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189564288:12345-0@lo:400:kworker.0 Request processed in 55us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845389.921866:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788845389.922285:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189564288:0@lo:400:kworker.0 00000100:00080000:2.0:1788845389.922400:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845390.428950:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845390.428977:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189564544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845390.429052:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845390.429165:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189564544 00000100:00100000:0.0:1788845390.429173:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189564544 00000100:00100000:0.0:1788845390.429224:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788845390.429252:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189564544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845390.429284:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845390.429471:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189564544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845390.429478:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788845390.432314:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeae294380 x1875740189564544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845390.432344:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189564544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788845390.683572:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788845390.971311:0:6682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c53707e2-5013-40b9-a38c-51554aa096c9 00010000:00010000:2.0:1788845391.708537:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845392.731700:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788845393.538621:0:10277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:1.0:1788845393.572700:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c53707e2-5013-40b9-a38c-51554aa096c9 00010000:00010000:3.0:1788845393.758714:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788845394.053031:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c53707e2-5013-40b9-a38c-51554aa096c9 00000100:00100000:1.0:1788845394.654617:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845394.654656:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845394.654686:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845394.654724:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845394.654752:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845394.654780:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180098048 00000100:00100000:1.0:1788845394.654788:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180098048 00000100:00100000:1.0:1788845394.654843:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180097920 00000100:00100000:1.0:1788845394.654846:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180097920 00000100:00100000:1.0:1788845394.654871:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:1.0:1788845394.654881:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180098048:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845394.654951:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180098048:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 72us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845394.654958:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:1.0:1788845394.654975:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:1.0:1788845394.654982:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180097920:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845394.654987:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180097792 00000100:00100000:3.0:1788845394.654991:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180097792 00000100:00100000:1.0:1788845394.655006:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180097920:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845394.655013:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:3.0:1788845394.655019:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 213 00000100:00100000:3.0:1788845394.655025:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:2372:x1875740180097792:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845394.655029:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180098304 00000100:00100000:1.0:1788845394.655031:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180098304 00000100:00100000:3.0:1788845394.655051:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:2372:x1875740180097792:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 27us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845394.655058:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 213 00000100:00100000:1.0:1788845394.655065:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180098176 00000100:00100000:1.0:1788845394.655068:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180098176 00000100:00100000:1.0:1788845394.655081:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:1.0:1788845394.655087:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180098304:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845394.655113:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180098304:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845394.655119:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:1.0:1788845394.655130:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:1.0:1788845394.655136:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180098176:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845394.655157:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180098176:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 21us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845394.655163:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00080000:1.0:1788845394.655185:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845394.655188:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845394.655190:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788845394.780429:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845395.035875:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189564928:0@lo:400:kworker.0 00000100:00100000:1.0:1788845395.036046:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189564672:0@lo:400:kworker.0 00000100:00100000:1.0:1788845395.036109:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845395.036154:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189565184:0@lo:400:kworker.0 00000100:00100000:1.0:1788845395.036189:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845395.036215:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788845395.036222:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189564800:0@lo:400:kworker.0 00000100:00100000:1.0:1788845395.036243:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845395.036275:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189565312:0@lo:400:kworker.0 00000100:00100000:1.0:1788845395.036300:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845395.036330:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189564672 00000100:00100000:1.0:1788845395.036343:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189564672 00000100:00100000:1.0:1788845395.036420:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788845395.036428:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189564672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845395.036468:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189564672:12345-0@lo:400:kworker.0 Request processed in 42us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845395.036475:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788845395.036504:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189565184 00000100:00100000:1.0:1788845395.036508:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189565184 00000100:00100000:1.0:1788845395.036540:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189564800 00000100:00100000:1.0:1788845395.036543:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189564800 00000100:00100000:1.0:1788845395.036561:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788845395.036569:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189565184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845395.036598:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189565056:0@lo:400:kworker.0 00000100:00100000:1.0:1788845395.036605:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189565184:12345-0@lo:400:kworker.0 Request processed in 35us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845395.036613:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788845395.036626:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788845395.036635:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189564800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845395.036641:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845395.036737:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189565312 00000100:00100000:0.0:1788845395.036742:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189565312 00000100:00100000:0.0:1788845395.036773:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189565056 00000100:00100000:0.0:1788845395.036776:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189565056 00000100:00100000:1.0:1788845395.036788:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189564800:12345-0@lo:400:kworker.0 Request processed in 154us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845395.036798:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788845395.036799:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788845395.036812:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189565312:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788845395.036823:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845395.036837:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845395.036840:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845395.036858:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189565312:12345-0@lo:400:kworker.0 Request processed in 49us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845395.036866:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788845395.036880:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845395.036887:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189565056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845395.036914:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189565056:12345-0@lo:400:kworker.0 Request processed in 28us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845395.036920:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845395.036959:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189564800:0@lo:400:kworker.0 00010000:00080000:0.0:1788845395.036970:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebca16a00 x1875740189565312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845395.036980:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189565312:0@lo:400:kworker.0 00000100:00100000:0.0:1788845395.036987:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189564672:0@lo:400:kworker.0 00000100:00100000:0.0:1788845395.036996:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189565184:0@lo:400:kworker.0 00010000:00080000:2.0:1788845395.037271:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebca17b80 x1875740189565056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845395.037281:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189565056:0@lo:400:kworker.0 00000100:00100000:2.0:1788845395.037293:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845395.037299:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189565440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845395.037325:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845395.037487:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845395.038008:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189565440 00000100:00100000:1.0:1788845395.038016:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189565440 00000100:00100000:1.0:1788845395.038310:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788845395.038319:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189565440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845395.038352:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845395.038522:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189564928 00000100:00100000:2.0:1788845395.038527:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189564928 00000100:00100000:2.0:1788845395.038570:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788845395.038577:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189564928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845395.038627:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189564928:12345-0@lo:400:kworker.0 Request processed in 50us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845395.038634:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788845395.038656:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845395.038681:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189564928:0@lo:400:kworker.0 00000100:00100000:1.0:1788845395.038965:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189565440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 645us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845395.038972:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788845395.039213:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae90c40a80 x1875740189565440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845395.039230:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189565440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845395.549630:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845395.549654:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189565568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845395.549726:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845395.552530:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189565568 00000100:00100000:2.0:1788845395.552545:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189565568 00000100:00100000:2.0:1788845395.552620:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788845395.552634:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189565568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845395.552675:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845395.552763:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189565568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845395.552780:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788845395.556422:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae90c40a80 x1875740189565568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845395.556444:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189565568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788845395.807754:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845396.829339:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845397.853602:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845398.876078:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845399.777772:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845399.777811:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845399.778014:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180098432 00000100:00100000:1.0:1788845399.778025:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180098432 00000100:00100000:1.0:1788845399.778083:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 215 00000100:00100000:1.0:1788845399.778093:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180098432:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845399.778181:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180098432:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 89us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845399.778189:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 215 00000100:00100000:1.0:1788845399.778233:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180098560 00000100:00100000:1.0:1788845399.778237:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180098560 00000100:00100000:1.0:1788845399.778275:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:1.0:1788845399.778282:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180098560:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845399.778312:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180098560:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845399.778319:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00080000:1.0:1788845399.778487:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845399.779072:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845399.779107:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845399.779142:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845399.780102:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180098688 00000100:00100000:1.0:1788845399.780111:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180098688 00000100:00100000:1.0:1788845399.780263:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:1.0:1788845399.780274:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180098688:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845399.780352:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180098688:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 80us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845399.780390:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00080000:2.0:1788845399.780548:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845399.782993:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180098816 00000100:00100000:1.0:1788845399.783020:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180098816 00000100:00100000:0.0:1788845399.783167:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180098944 00000100:00100000:0.0:1788845399.783172:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180098944 00000100:00100000:1.0:1788845399.783259:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:1.0:1788845399.783271:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180098816:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845399.783349:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180098816:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 80us (4241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845399.783358:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00080000:2.0:1788845399.788098:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845399.788108:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845399.791095:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:0.0:1788845399.791114:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180098944:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845399.791200:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180098944:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 92us (12056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845399.791207:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 27 00010000:00010000:1.0:1788845399.906196:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845400.155548:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845400.155571:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189565696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845400.155644:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845400.155727:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189565696 00000100:00100000:2.0:1788845400.155735:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189565696 00000100:00100000:1.0:1788845400.156231:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189565952:0@lo:400:kworker.0 00000100:00100000:1.0:1788845400.156270:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845400.156296:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845400.156302:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189566080:0@lo:400:kworker.0 00000100:00100000:1.0:1788845400.156323:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845400.156351:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189565952 00000100:00100000:1.0:1788845400.156355:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189565952 00000100:00100000:3.0:1788845400.156570:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189565824:0@lo:400:kworker.0 00000100:00100000:3.0:1788845400.156614:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845400.156934:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189566336:0@lo:400:kworker.0 00000100:00100000:3.0:1788845400.156964:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845400.157286:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788845400.157300:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189565696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845400.157335:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845400.157474:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189565696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845400.157483:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788845400.157514:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845400.157530:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae9eac2d80 x1875740189565696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845400.157550:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189565696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845400.157576:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845400.157582:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eb2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189566208:0@lo:400:kworker.0 00000100:00100000:1.0:1788845400.158255:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189566080 00000100:00100000:1.0:1788845400.158262:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189566080 00000100:00100000:1.0:1788845400.158294:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788845400.158302:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189565952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845400.158355:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189565952:12345-0@lo:400:kworker.0 Request processed in 54us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845400.158385:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788845400.158394:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788845400.158404:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189566080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845400.158440:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189566080:12345-0@lo:400:kworker.0 Request processed in 39us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845400.158446:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788845400.158479:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845400.158500:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845400.158584:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189566208 00000100:00100000:2.0:1788845400.158588:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189566208 00000100:00100000:2.0:1788845400.158627:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788845400.158634:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189566208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845400.158670:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189566208:12345-0@lo:400:kworker.0 Request processed in 36us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845400.158682:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788845400.158686:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845400.158718:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eb2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189566208:0@lo:400:kworker.0 00000100:00100000:1.0:1788845400.158948:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189566336 00000100:00100000:1.0:1788845400.158959:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189566336 00000100:00100000:2.0:1788845400.159057:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189565824 00000100:00100000:2.0:1788845400.159063:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189565824 00000100:00100000:2.0:1788845400.159094:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788845400.159100:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189565824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845400.159142:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189565824:12345-0@lo:400:kworker.0 Request processed in 42us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845400.159149:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:3.0:1788845400.162139:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845400.162196:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189565824:0@lo:400:kworker.0 00000100:00100000:1.0:1788845400.164913:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788845400.164940:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189566336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845400.165043:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189566336:12345-0@lo:400:kworker.0 Request processed in 116us (8077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845400.165050:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788845400.165171:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae9eb28a80 x1875740189566336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845400.165187:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189566336:0@lo:400:kworker.0 00000100:00100000:1.0:1788845400.167295:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189566080:0@lo:400:kworker.0 00000100:00100000:1.0:1788845400.167312:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189565952:0@lo:400:kworker.0 00000100:00100000:1.0:1788845400.674655:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189566464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845400.674729:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845400.674880:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189566464 00000100:00100000:0.0:1788845400.674897:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189566464 00000100:00100000:0.0:1788845400.674950:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788845400.674959:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189566464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845400.674993:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845400.677270:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189566464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2302us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845400.677283:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788845400.679675:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae9eac0700 x1875740189566464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845400.679705:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189566464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788845400.923898:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845401.948249:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845402.972839:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845403.995525:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845404.890929:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845404.890975:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845404.891020:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845404.891040:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845404.891066:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845404.891079:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180099200 00000100:00100000:3.0:1788845404.891090:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180099200 00000100:00100000:1.0:1788845404.891091:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180099072 00000100:00100000:1.0:1788845404.891098:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180099072 00000100:00100000:1.0:1788845404.891148:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 217 00000100:00100000:3.0:1788845404.891151:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180099328 00000100:00100000:3.0:1788845404.891156:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180099328 00000100:00100000:1.0:1788845404.891161:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2375:x1875740180099072:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845404.891185:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:3.0:1788845404.891194:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180099200:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845404.891275:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180099200:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 82us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845404.891289:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:3.0:1788845404.891308:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:3.0:1788845404.891315:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2375:x1875740180099328:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845404.891348:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2375:x1875740180099328:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 34us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845404.891358:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00080000:3.0:1788845404.891396:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845404.891461:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180099456 00000100:00100000:0.0:1788845404.891466:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180099456 00000100:00100000:0.0:1788845404.891495:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180099584 00000100:00100000:0.0:1788845404.891498:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180099584 00000100:00100000:0.0:1788845404.891512:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:0.0:1788845404.891518:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2375:x1875740180099456:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845404.891545:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2375:x1875740180099456:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845404.891558:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:0.0:1788845404.891575:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:0.0:1788845404.891580:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2375:x1875740180099584:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845404.891605:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2375:x1875740180099584:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 24us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845404.891611:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00080000:3.0:1788845404.891657:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845404.891661:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845404.892186:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2375:x1875740180099072:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 1027us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845404.892206:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 217 00010000:00010000:1.0:1788845405.022320:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845405.276160:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189566720:0@lo:400:kworker.0 00000100:00100000:1.0:1788845405.276230:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189566592:0@lo:400:kworker.0 00000100:00100000:2.0:1788845405.276246:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845405.276938:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189566976:0@lo:400:kworker.0 00000100:00100000:2.0:1788845405.277061:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189567232:0@lo:400:kworker.0 00000100:00100000:2.0:1788845405.277091:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845405.277122:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788845405.277128:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189566848:0@lo:400:kworker.0 00000100:00100000:2.0:1788845405.277150:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845405.277173:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189567360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845405.277214:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845405.277215:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845405.277222:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845405.277400:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189566720 00000100:00100000:2.0:1788845405.277407:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189566720 00000100:00100000:2.0:1788845405.277445:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189566848 00000100:00100000:2.0:1788845405.277458:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189566848 00000100:00100000:0.0:1788845405.277480:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189567232 00000100:00100000:0.0:1788845405.277486:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189567232 00000100:00100000:2.0:1788845405.277493:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788845405.277503:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189566720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845405.277516:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189567104:0@lo:400:kworker.0 00000100:00100000:2.0:1788845405.277554:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189566720:12345-0@lo:400:kworker.0 Request processed in 53us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845405.277561:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845405.277568:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788845405.277586:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189567104 00000100:00100000:2.0:1788845405.277590:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189567104 00000100:00100000:0.0:1788845405.277640:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189566976 00000100:00100000:0.0:1788845405.277645:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189566976 00000100:00100000:0.0:1788845405.277662:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788845405.277670:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189567232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845405.277707:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189567232:12345-0@lo:400:kworker.0 Request processed in 38us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845405.277714:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788845405.277728:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788845405.277734:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189566976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845405.277766:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189566976:12345-0@lo:400:kworker.0 Request processed in 32us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845405.277772:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788845405.277781:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788845405.277791:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189566592 00000100:00100000:2.0:1788845405.277793:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189566848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845405.277797:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189566592 00000100:00100000:0.0:1788845405.277828:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788845405.277832:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189566848:12345-0@lo:400:kworker.0 Request processed in 42us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845405.277847:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189566592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845405.277863:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788845405.277870:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788845405.277878:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875740189567104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845405.277895:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189566592:12345-0@lo:400:kworker.0 Request processed in 51us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845405.277903:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189567360 00000100:00100000:0.0:1788845405.277904:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788845405.277908:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189567360 00000100:00100000:1.0:1788845405.277928:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875740189567104:12345-0@lo:400:kworker.0 Request processed in 56us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845405.277937:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788845405.277941:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788845405.277950:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189567360:12345-0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788845405.277962:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae8fcbdc00 x1875740189566976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1788845405.277979:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845405.277979:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189566976:0@lo:400:kworker.0 00000100:00100000:1.0:1788845405.277994:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189566720:0@lo:400:kworker.0 00000100:00100000:2.0:1788845405.278015:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189567360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845405.278023:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788845405.278028:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae8fcbc700 x1875740189567232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845405.278032:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189566592:0@lo:400:kworker.0 00000100:00080000:2.0:1788845405.278041:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788845405.278047:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845405.278048:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189567232:0@lo:400:kworker.0 00000100:00080000:2.0:1788845405.278051:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845405.278053:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189567104:0@lo:400:kworker.0 00000100:00100000:1.0:1788845405.278088:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189566848:0@lo:400:kworker.0 00010000:00080000:1.0:1788845405.278100:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeae295500 x1875740189567360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845405.278114:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189567360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845405.787560:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189567488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845405.787634:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845405.787779:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189567488 00000100:00100000:1.0:1788845405.787805:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189567488 00000100:00100000:1.0:1788845405.787851:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788845405.787860:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189567488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845405.787894:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845405.787941:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189567488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845405.787949:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788845405.787991:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae9eb28380 x1875740189567488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845405.788009:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189567488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788845406.045264:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788845406.980024:0:10979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788845407.068683:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845408.092495:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845409.124192:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788845409.583216:0:11126:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed646bee0 20000000:00000080:1.0:1788845409.583238:0:11126:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92aeae274000 uarg=0000000000000000 20000000:01000000:1.0:1788845409.583277:0:11126:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788845409.583284:0:11126:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788845409.583290:0:11126:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788845409.588973:0:11127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788845409.589163:0:11126:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788845409.597562:0:11126:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788845409.597599:0:11126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.597618:0:11126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6df9788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9781 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.597627:0:11126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae81480200/0xd8041b54d6df97b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df97ab expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.597655:0:11126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df97dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df97d5 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.597665:0:11126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae8fd1f600/0xd8041b54d6df97f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752258 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.597671:0:11126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae8fd1f200/0xd8041b54d6df9806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752290 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.597679:0:11126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.597721:0:11126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae8fd1f200/0xd8041b54d6df9806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752290 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.597738:0:11126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ae8fd1f200/0xd8041b54d6df9806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752290 expref: 12 pid: 5810 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845409.597754:0:11126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eb28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875740189567616:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845409.597928:0:11126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae8fd1f600/0xd8041b54d6df97f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752258 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.597938:0:11126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ae8fd1f600/0xd8041b54d6df97f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752258 expref: 12 pid: 5811 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845409.597946:0:11126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eb29500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875740189567744:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845409.597979:0:11126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df97dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df97d5 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.597999:0:11126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df97dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df97d5 expref: 18 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845409.598010:0:11126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eb29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875740189567872:0@lo:104: 00000100:00100000:1.0:1788845409.598053:0:11126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845409.598101:0:11126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae81480200/0xd8041b54d6df97b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df97ab expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.598109:0:11126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae81480200/0xd8041b54d6df97b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df97ab expref: 18 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845409.598117:0:11126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eb2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875740189568000:0@lo:104: 00000100:00100000:1.0:1788845409.598141:0:11126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845409.598192:0:11126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6df9788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df9781 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.598201:0:11126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6df9788 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df9781 expref: 18 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845409.598209:0:11126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eb29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875740189568128:0@lo:104: 00000100:00100000:1.0:1788845409.598233:0:11126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845409.598253:0:11126:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fd8ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788845409.601085:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189567872 00000100:00100000:2.0:1788845409.601101:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189567872 00000100:00100000:2.0:1788845409.601151:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189568000 00000100:00100000:2.0:1788845409.601181:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189568000 00000100:00100000:2.0:1788845409.601202:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189568128 00000100:00100000:2.0:1788845409.601205:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189568128 00000100:00100000:2.0:1788845409.601221:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788845409.601229:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:11126:x1875740189567872:12345-0@lo:104: 00010000:00010000:2.0:1788845409.601245:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601342:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788845409.601349:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+5:11126:x1875740189567872:12345-0@lo:104: Request processed in 121us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845409.601356:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788845409.601392:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788845409.601399:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:11126:x1875740189568000:12345-0@lo:104: 00010000:00010000:2.0:1788845409.601407:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601447:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788845409.601453:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:11126:x1875740189568000:12345-0@lo:104: Request processed in 55us (3312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845409.601458:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788845409.601470:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788845409.601474:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:11126:x1875740189568128:12345-0@lo:104: 00010000:00010000:2.0:1788845409.601482:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601514:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788845409.601519:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:11126:x1875740189568128:12345-0@lo:104: Request processed in 45us (3286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845409.601532:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788845409.601557:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788845409.601562:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601569:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81480400 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845409.601574:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601581:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845409.601589:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845409.601595:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845409.601630:0:8417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601636:0:8417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845409.601658:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601665:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae81480400/0xd8041b54d6df97d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df97dc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601681:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788845409.601684:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601700:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481200 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845409.601703:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601709:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845409.601715:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845409.601721:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845409.601738:0:8417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601744:0:8417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845409.601762:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601769:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae81481200/0xd8041b54d6df97ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df97b2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601780:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845409.601784:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601790:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481c00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845409.601792:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601810:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845409.601816:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845409.601822:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845409.601836:0:8417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601849:0:8417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845409.601856:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601862:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae81481c00/0xd8041b54d6df9781 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9788 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.601875:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845409.601877:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845409.601879:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845409.601886:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845409.601893:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845409.601907:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189568256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845409.601951:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845409.602000:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189568384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845409.602006:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189568256 00000100:00100000:0.0:1788845409.602013:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189568256 00000100:00100000:2.0:1788845409.602028:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845409.602050:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788845409.602051:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df97dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df97d5 expref: 19 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845409.602059:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189568512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845409.602076:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189568384 00000100:00100000:0.0:1788845409.602080:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189568384 00010000:00010000:0.0:1788845409.602095:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae81480200/0xd8041b54d6df97b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df97ab expref: 20 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845409.602102:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845409.602251:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845409.602570:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189568512 00000100:00100000:0.0:1788845409.602575:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189568512 00010000:00010000:0.0:1788845409.602591:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6df9788 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9781 expref: 21 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845409.602607:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845409.602623:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+21:3285:x1875740189568256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845409.602634:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845409.602640:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df97dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df97d5 expref: 21 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845409.602650:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df97dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df97d5 expref: 21 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845409.602665:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845409.603185:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6df97dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df97d5 expref: 21 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845409.603202:0:11126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eb29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875740189567872:0@lo:104: 00000100:00100000:1.0:1788845409.603215:0:11126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eb2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875740189568000:0@lo:104: 00000100:00100000:1.0:1788845409.603224:0:11126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eb29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875740189568128:0@lo:104: 00000100:00100000:2.0:1788845409.603528:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788845409.603538:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+20:3283:x1875740189568384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788845409.603550:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845409.603557:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae81480200/0xd8041b54d6df97b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df97ab expref: 20 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.603567:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae81480200/0xd8041b54d6df97b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df97ab expref: 20 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.603579:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81480200/0xd8041b54d6df97b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df97ab expref: 20 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.603589:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845409.603785:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788845409.603796:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189568512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845409.603804:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845409.603808:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6df9788 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9781 expref: 19 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845409.603816:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6df9788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df9781 expref: 19 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845409.603826:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6df9788 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df9781 expref: 19 pid: 5811 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845409.603835:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845409.603912:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3283:x1875740189568384:12345-0@lo:103:ldlm_bl.0 Request processed in 376us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845409.603920:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788845409.604159:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189568384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788845409.606064:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845409.606134:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180099712 00000100:00100000:2.0:1788845409.606143:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180099712 00010000:00010000:2.0:1788845409.606190:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae8fd1f200/0xd8041b54d6df9806 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752290 expref: 13 pid: 5810 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845409.606227:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:2.0:1788845409.606237:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a83c90f8-270b-4823-9416-881b40e3aa44+13:2372:x1875740180099712:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845409.606250:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845409.606255:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae8fd1f200/0xd8041b54d6df9806 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752290 expref: 13 pid: 5810 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.606290:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae8fd1f200/0xd8041b54d6df9806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752290 expref: 13 pid: 5810 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.606308:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845409.606354:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a83c90f8-270b-4823-9416-881b40e3aa44+13:2372:x1875740180099712:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 119us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845409.606394:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 28 00010000:00010000:2.0:1788845409.606444:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1f200/0xd8041b54d6df9806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752290 expref: 12 pid: 5810 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845409.606475:0:11126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eb28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875740189567616:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845409.606486:0:11126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eb29500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11126:1875740189567744:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845409.606530:0:11126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845409.607079:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:3285:x1875740189568256:12345-0@lo:103:ldlm_bl.0 Request processed in 4454us (5123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845409.607089:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788845409.607672:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3283:x1875740189568512:12345-0@lo:103:ldlm_bl.0 Request processed in 3876us (5571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845409.607680:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788845409.607774:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189568512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845409.608645:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189568256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845409.612253:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845409.613225:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180099840 00000100:00100000:2.0:1788845409.613238:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180099840 00010000:00010000:2.0:1788845409.613279:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae8fd1f600/0xd8041b54d6df97f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752258 expref: 12 pid: 5811 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845409.613412:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:1.0:1788845409.613426:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a83c90f8-270b-4823-9416-881b40e3aa44+12:2375:x1875740180099840:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845409.613442:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845409.613449:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae8fd1f600/0xd8041b54d6df97f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752258 expref: 12 pid: 5811 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613463:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae8fd1f600/0xd8041b54d6df97f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752258 expref: 12 pid: 5811 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613482:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1f600/0xd8041b54d6df97f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752258 expref: 12 pid: 5811 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613502:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613511:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613531:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613538:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613544:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613571:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613577:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a53800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845409.613581:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613590:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613613:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845409.613623:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845409.613687:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a83c90f8-270b-4823-9416-881b40e3aa44+11:2375:x1875740180099840:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 265us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845409.613695:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 29 00010000:00010000:2.0:1788845409.614163:0:11126:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.614185:0:11126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845409.614204:0:11126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae89a53800/0xd8041b54d6df9822 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845410.011571:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845410.011628:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845410.011674:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845410.011794:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180099968 00000100:00100000:2.0:1788845410.011804:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180099968 00000100:00100000:2.0:1788845410.011863:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 219 00000100:00100000:2.0:1788845410.011873:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+11:2373:x1875740180099968:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845410.012563:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+11:2373:x1875740180099968:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 688us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845410.012573:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 219 00000100:00100000:1.0:1788845410.016296:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180100224 00000100:00100000:1.0:1788845410.016313:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180100224 00000100:00100000:3.0:1788845410.016464:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180100096 00000100:00100000:3.0:1788845410.016469:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180100096 00000100:00080000:0.0:1788845410.016502:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845410.018318:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:1.0:1788845410.018340:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180100224:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845410.018432:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180100224:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 103us (6804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845410.018439:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:3.0:1788845410.019386:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:3.0:1788845410.019398:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180100096:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845410.019447:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180100096:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 52us (7773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845410.019455:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:1.0:1788845410.028445:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845410.029649:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845410.030748:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180100352 00000100:00100000:2.0:1788845410.030761:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180100352 00000100:00100000:2.0:1788845410.030955:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180100480 00000100:00100000:2.0:1788845410.030959:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180100480 00000100:00100000:2.0:1788845410.030984:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:2.0:1788845410.030994:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2371:x1875740180100352:12345-192.168.206.35@tcp:9:kworker.0 00000020:00000080:2.0:1788845410.031025:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9814 00000100:00080000:2.0:1788845410.031035:0:6656:0:(import.c:65:import_set_state_nolock()) ffff92aeae46d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788845410.031075:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788845410.032020:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+2:2371:x1875740180100352:12345-192.168.206.35@tcp:9:kworker.0 Request processed in 1021us (3584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845410.032031:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:2.0:1788845410.032058:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:2.0:1788845410.032067:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2371:x1875740180100480:12345-192.168.206.35@tcp:9:kworker.0 00000020:00000080:2.0:1788845410.032086:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df981b 00000100:00080000:2.0:1788845410.032103:0:6656:0:(import.c:65:import_set_state_nolock()) ffff92aeae46e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788845410.032128:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788845410.032356:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c53707e2-5013-40b9-a38c-51554aa096c9+2:2371:x1875740180100480:12345-192.168.206.35@tcp:9:kworker.0 Request processed in 289us (2711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845410.032389:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00010000:00010000:2.0:1788845410.032415:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845410.032421:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788845410.032627:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845410.032632:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788845410.142455:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845410.397062:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189568896:0@lo:400:kworker.0 00000100:00100000:2.0:1788845410.397137:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845410.397224:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845410.397231:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189569024:0@lo:400:kworker.0 00000100:00100000:2.0:1788845410.397259:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845410.397284:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189568640:0@lo:400:kworker.0 00000100:00100000:2.0:1788845410.397307:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189568896 00000100:00100000:2.0:1788845410.397315:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189568896 00000100:00100000:3.0:1788845410.397328:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845410.397391:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189569152:0@lo:400:kworker.0 00000100:00100000:2.0:1788845410.397403:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788845410.397414:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189568896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845410.397422:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845410.397454:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788845410.397462:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189568768:0@lo:400:kworker.0 00000100:00100000:2.0:1788845410.397477:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189568896:12345-0@lo:400:kworker.0 Request processed in 65us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845410.397491:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845410.397516:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189569280:0@lo:400:kworker.0 00000100:00100000:3.0:1788845410.397538:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845410.397562:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189568640 00000100:00100000:3.0:1788845410.397566:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189568640 00000100:00100000:3.0:1788845410.397603:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788845410.397609:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3285:x1875740189568640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845410.397640:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3285:x1875740189568640:12345-0@lo:400:kworker.0 Request processed in 31us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845410.397646:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788845410.397673:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189569152 00000100:00100000:0.0:1788845410.397931:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189568768 00000100:00100000:3.0:1788845410.397935:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189569152 00000100:00100000:0.0:1788845410.397937:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189568768 00000100:00100000:3.0:1788845410.397974:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788845410.398014:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189569152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845410.398048:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189569152:12345-0@lo:400:kworker.0 Request processed in 68us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845410.398400:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788845410.398413:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189568768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845410.398452:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189568768:12345-0@lo:400:kworker.0 Request processed in 44us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845410.398458:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788845410.398483:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189569024 00000100:00100000:0.0:1788845410.398486:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189569024 00000100:00100000:0.0:1788845410.398511:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189569280 00000100:00100000:0.0:1788845410.398514:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189569280 00000100:00100000:0.0:1788845410.398526:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788845410.398532:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189569024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845410.398566:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189569024:12345-0@lo:400:kworker.0 Request processed in 35us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845410.398583:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788845410.398595:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788845410.398600:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189569280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845410.398630:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189569280:12345-0@lo:400:kworker.0 Request processed in 30us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845410.398636:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788845410.399410:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788845410.399442:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845410.399446:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788845410.399448:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845410.399456:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845410.399469:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189569408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845410.399511:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788845410.399566:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae8fcbd180 x1875740189569024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845410.399596:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189569024:0@lo:400:kworker.0 00000100:00100000:2.0:1788845410.399612:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189568896:0@lo:400:kworker.0 00000100:00100000:2.0:1788845410.401874:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189568768:0@lo:400:kworker.0 00010000:00080000:2.0:1788845410.401897:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae8fcbf100 x1875740189569280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845410.401908:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189569280:0@lo:400:kworker.0 00000100:00100000:2.0:1788845410.401919:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189568640:0@lo:400:kworker.0 00000100:00100000:2.0:1788845410.401933:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189569152:0@lo:400:kworker.0 00000100:00100000:3.0:1788845410.403056:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788845410.403325:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189569408 00000100:00100000:1.0:1788845410.403334:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189569408 00000100:00100000:1.0:1788845410.403404:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788845410.403414:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189569408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845410.403453:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845410.403532:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189569408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (4019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845410.403538:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788845410.403586:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeae295f80 x1875740189569408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845410.403604:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189569408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845410.908569:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845410.908594:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189569536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845410.908664:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845410.908734:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189569536 00000100:00100000:1.0:1788845410.908741:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189569536 00000100:00100000:1.0:1788845410.908787:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788845410.908795:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189569536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845410.908827:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845410.908871:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189569536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845410.908878:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788845410.908914:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae9eb2b100 x1875740189569536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845410.908948:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189569536:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788845410.909008:0:5814:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788845410.909013:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92aeb79e4000 from 7 10000000:01000000:2.0:1788845410.909017:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845410.909049:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845410.909060:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845410.909070:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845410.909087:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189569664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845410.909120:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845410.909149:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845410.909200:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189569664 00000100:00100000:1.0:1788845410.909205:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189569664 00000100:00100000:1.0:1788845410.909330:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788845410.909338:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189569664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845410.909348:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845410.909385:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae89a52e00/0xd8041b54d6df9830 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9829 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845410.909408:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae89a52e00/0xd8041b54d6df9830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9829 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845410.909419:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae89a52e00/0xd8041b54d6df9830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9829 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845410.909427:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a52e00, rc 0) 00000100:00100000:1.0:1788845410.909458:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189569664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845410.909464:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788845410.909529:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189569664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845410.909542:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845410.909551:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845410.909602:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189569792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845410.909628:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845410.913687:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc2603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845410.913817:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189569792 00000100:00100000:2.0:1788845410.913839:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189569792 00000100:00100000:2.0:1788845410.913886:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788845410.913896:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189569792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845410.914295:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189569792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (4665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845410.914303:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788845410.917875:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189569792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845410.917945:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189569920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845410.918019:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845410.918068:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc2603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845410.918127:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189569920 00000100:00100000:2.0:1788845410.918134:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189569920 00000100:00100000:2.0:1788845410.918191:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788845410.918200:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189569920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845410.918422:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189569920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845410.918429:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788845410.918544:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189569920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788845410.919508:0:11183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788845410.920555:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788845410.920580:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845410.920592:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845410.920605:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845410.920616:0:5814:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788845410.920618:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ae8fcc6800 from 7 10000000:01000000:0.0:1788845410.920621:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845410.920658:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845410.920666:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845410.920676:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845410.920701:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae295c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845410.920767:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845410.920856:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845410.921450:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189570048 00000100:00100000:2.0:1788845410.921459:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189570048 00000100:00100000:2.0:1788845410.921508:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788845410.921518:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189570048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845410.921532:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845410.921546:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df983e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9837 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845410.921573:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df983e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9837 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845410.921585:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df983e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9837 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845410.921593:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0200, rc 0) 00000100:00100000:2.0:1788845410.923797:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189570048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2266us (3015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845410.923811:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788845410.924092:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae295c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845410.924114:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845410.924127:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845410.924231:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845410.924283:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845410.924388:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc260f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845410.926489:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189570176 00000100:00100000:2.0:1788845410.926504:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189570176 00000100:00100000:2.0:1788845410.926614:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788845410.926625:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189570176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845410.926940:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189570176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 316us (2656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845410.926948:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788845410.927029:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845410.927074:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845410.927119:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845410.932411:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc260f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845410.937394:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189570304 00000100:00100000:1.0:1788845410.937413:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189570304 00000100:00100000:1.0:1788845410.937486:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788845410.937495:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189570304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845410.937756:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189570304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 261us (10636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845410.937763:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788845410.937991:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788845410.939083:0:11184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788845410.939287:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788845410.939306:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845410.939316:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845410.939328:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845410.939339:0:5814:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788845410.939341:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ae90de3800 from 7 10000000:01000000:2.0:1788845410.939344:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845410.939421:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845410.939430:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845410.939440:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845410.939480:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845410.939534:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845410.939575:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845410.939840:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189570432 00000100:00100000:3.0:1788845410.939846:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189570432 00000100:00100000:3.0:1788845410.939894:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788845410.939902:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189570432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845410.939914:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845410.939926:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6df984c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df9845 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845410.939948:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6df984c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df9845 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845410.939957:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6df984c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9845 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845410.939966:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748aa00, rc 0) 00000100:00100000:3.0:1788845410.940006:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189570432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845410.940018:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788845410.940059:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845410.940072:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845410.940081:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845410.940130:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845410.940156:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845410.940188:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc2603c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845410.940200:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189570560 00000100:00100000:3.0:1788845410.940204:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189570560 00000100:00100000:3.0:1788845410.940228:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788845410.940233:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189570560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845410.940519:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189570560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845410.940526:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788845410.940553:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845410.940579:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845410.940615:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845410.940628:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc2603c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845410.940639:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189570688 00000100:00100000:3.0:1788845410.940643:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189570688 00000100:00100000:3.0:1788845410.940660:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788845410.940674:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189570688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845410.940807:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189570688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845410.940813:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788845410.940847:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189570688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788845410.941546:0:11185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788845410.941605:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788845410.941618:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845410.941627:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845410.941637:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845411.163597:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845411.298575:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845411.303738:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180100608 00000100:00100000:3.0:1788845411.303755:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180100608 00000100:00100000:3.0:1788845411.303822:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 230 00000100:00100000:3.0:1788845411.303841:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+11:5614:x1875740180100608:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845411.303857:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845411.303882:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb748a600/0xd8041b54d6df9853 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce120077522ba expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845411.303912:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb748a600/0xd8041b54d6df9853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522ba expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845411.303924:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb748a600/0xd8041b54d6df9853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522ba expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845411.303946:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a600, rc 0) 00000100:00100000:3.0:1788845411.304008:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180100608:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 169us (5443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845411.304015:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 230 00000100:00100000:2.0:1788845411.314071:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845411.317309:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180100736 00000100:00100000:3.0:1788845411.317326:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180100736 00000100:00100000:3.0:1788845411.317481:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 231 00000100:00100000:3.0:1788845411.317492:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180100736:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845411.317818:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180100736:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 328us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845411.317901:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 231 00000100:00100000:3.0:1788845411.328708:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845411.328786:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180100864 00000100:00100000:2.0:1788845411.328796:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180100864 00000100:00100000:2.0:1788845411.328858:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 232 00000100:00100000:2.0:1788845411.328869:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180100864:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845411.329091:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180100864:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 223us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845411.329099:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 232 00000100:00100000:2.0:1788845411.332867:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845411.332977:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180100992 00000100:00100000:3.0:1788845411.332987:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180100992 00000100:00100000:3.0:1788845411.333040:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 233 00000100:00100000:3.0:1788845411.333050:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180100992:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845411.333066:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845411.333083:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb748a200/0xd8041b54d6df985a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce120077522c1 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845411.333112:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb748a200/0xd8041b54d6df985a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522c1 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845411.333122:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb748a200/0xd8041b54d6df985a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522c1 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845411.333147:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a200, rc 0) 00000100:00100000:3.0:1788845411.333209:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:5614:x1875740180100992:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 161us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845411.333216:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 233 00000100:00100000:2.0:1788845411.334628:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845411.334696:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180101120 00000100:00100000:3.0:1788845411.334704:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180101120 00000100:00100000:3.0:1788845411.334749:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 234 00000100:00100000:3.0:1788845411.334758:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:5614:x1875740180101120:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845411.335045:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:5614:x1875740180101120:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 286us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845411.335053:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 234 00000100:00100000:3.0:1788845411.336463:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845411.336568:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180101248 00000100:00100000:2.0:1788845411.336575:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180101248 00000100:00100000:2.0:1788845411.336617:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 235 00000100:00100000:2.0:1788845411.336626:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:5614:x1875740180101248:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845411.336821:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:5614:x1875740180101248:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 195us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845411.336840:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 235 00000001:00100000:1.0:1788845411.477019:0:6682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c53707e2-5013-40b9-a38c-51554aa096c9 00000020:00000080:1.0:1788845411.477031:0:6682:0:(genops.c:885:class_export_put()) final put ffff92aeae469000/c53707e2-5013-40b9-a38c-51554aa096c9 00000020:00000080:0.0:1788845411.477252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae469000/c53707e2-5013-40b9-a38c-51554aa096c9 for lustre-OST0000 00000020:00000080:0.0:1788845411.477306:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aeae46d800 for lustre-OST0000 00010000:00010000:3.0:1788845412.187510:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845412.818144:0:11325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788845413.212934:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845414.236701:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788845414.548264:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c53707e2-5013-40b9-a38c-51554aa096c9 00000020:00000080:1.0:1788845414.548273:0:7612:0:(genops.c:885:class_export_put()) final put ffff92aeae46b000/c53707e2-5013-40b9-a38c-51554aa096c9 00000020:00000080:1.0:1788845414.548300:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae46b000/c53707e2-5013-40b9-a38c-51554aa096c9 for lustre-OST0001 00000020:00000080:1.0:1788845414.548345:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aeae46e000 for lustre-OST0001 00000100:00100000:2.0:1788845415.130484:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845415.130595:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845415.130627:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845415.130722:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180101376 00000100:00100000:0.0:1788845415.130722:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180101504 00000100:00100000:0.0:1788845415.130731:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180101504 00000100:00100000:1.0:1788845415.130763:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180101632 00000100:00100000:1.0:1788845415.130768:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180101632 00000100:00100000:1.0:1788845415.130805:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:0.0:1788845415.130810:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:1.0:1788845415.130814:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c53707e2-5013-40b9-a38c-51554aa096c9+5:2375:x1875740180101632:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845415.130817:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180101504:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845415.130886:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180101376 00000100:00080000:2.0:1788845415.130892:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845415.130950:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180101504:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 133us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845415.130961:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:3.0:1788845415.130998:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 236 00000100:00100000:3.0:1788845415.131008:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2375:x1875740180101376:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845415.131054:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c53707e2-5013-40b9-a38c-51554aa096c9+5:2375:x1875740180101632:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 241us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845415.131062:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:3.0:1788845415.131244:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2375:x1875740180101376:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 236us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845415.131252:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 236 00010000:00010000:1.0:1788845415.261230:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845415.506600:0:11425:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:30:13 (1788845413) === 00000100:00100000:3.0:1788845415.516208:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189570816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845415.516280:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845415.516753:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189571072:0@lo:400:kworker.0 00000100:00100000:3.0:1788845415.516788:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845415.516834:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845415.516842:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189571200:0@lo:400:kworker.0 00000100:00100000:3.0:1788845415.516867:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845415.516900:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189571072 00000100:00100000:3.0:1788845415.516907:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189571072 00000100:00100000:3.0:1788845415.516951:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189571200 00000100:00100000:3.0:1788845415.516954:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189571200 00000100:00100000:3.0:1788845415.517002:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788845415.517011:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189571072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845415.517029:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189570944:0@lo:400:kworker.0 00000100:00100000:3.0:1788845415.517159:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189571072:12345-0@lo:400:kworker.0 Request processed in 148us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845415.517166:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788845415.517184:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788845415.517190:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189571200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845415.517223:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189571200:12345-0@lo:400:kworker.0 Request processed in 33us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845415.517229:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788845415.517246:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845415.517278:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189571200:0@lo:400:kworker.0 00000100:00100000:3.0:1788845415.517290:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189571072:0@lo:400:kworker.0 00000100:00100000:3.0:1788845415.517313:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189571328:0@lo:400:kworker.0 00000100:00100000:3.0:1788845415.517337:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845415.517388:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189571328 00000100:00100000:3.0:1788845415.517392:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189571328 00000100:00100000:3.0:1788845415.517421:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788845415.517428:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189571328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845415.517473:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189571328:12345-0@lo:400:kworker.0 Request processed in 45us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845415.517479:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788845415.517493:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845415.517508:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189571328:0@lo:400:kworker.0 00000100:00100000:1.0:1788845415.519048:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845415.519104:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189571456:0@lo:400:kworker.0 00000100:00100000:1.0:1788845415.519164:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845415.519707:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189570944 00000100:00100000:2.0:1788845415.519715:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189570944 00000100:00100000:2.0:1788845415.519768:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788845415.519778:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189570944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845415.519832:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189570944:12345-0@lo:400:kworker.0 Request processed in 56us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845415.519840:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788845415.519892:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189570816 00000100:00100000:0.0:1788845415.519897:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189570816 00000100:00100000:0.0:1788845415.519940:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189571456 00000100:00100000:0.0:1788845415.519943:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189571456 00000100:00100000:0.0:1788845415.520206:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788845415.520215:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189571456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845415.520256:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189571456:12345-0@lo:400:kworker.0 Request processed in 44us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845415.520263:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788845415.520285:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845415.520304:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845415.520439:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189570944:0@lo:400:kworker.0 00010000:00080000:2.0:1788845415.520456:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebca14a80 x1875740189571456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845415.520468:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189571456:0@lo:400:kworker.0 00000100:00100000:0.0:1788845415.521196:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788845415.521208:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189570816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845415.521241:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845415.521295:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189570816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (5015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845415.521310:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788845415.521349:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeae297800 x1875740189570816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845415.521392:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189570816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845415.619829:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845415.619875:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845415.619933:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180101760 00000100:00100000:2.0:1788845415.619943:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180101760 00000100:00100000:2.0:1788845415.619998:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:2.0:1788845415.620009:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180101760:12345-192.168.206.35@tcp:41:mkdir.0 00000004:00000024:2.0:1788845415.620053:0:5818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788845415.620148:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180101760:12345-192.168.206.35@tcp:41:mkdir.0 Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845415.620157:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:2.0:1788845415.620187:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180101888 00000100:00100000:2.0:1788845415.620197:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180101888 00000100:00100000:2.0:1788845415.620223:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:2.0:1788845415.620231:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:704fd1fa-8fb6-403c-867f-b875231088ec+6:9689:x1875740180101888:12345-192.168.206.35@tcp:700:mkdir.0 00000100:00100000:2.0:1788845415.620265:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:704fd1fa-8fb6-403c-867f-b875231088ec+6:9689:x1875740180101888:12345-192.168.206.35@tcp:700:mkdir.0 Request processed in 36us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845415.620271:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:2.0:1788845415.624884:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845415.624967:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180102144 00000100:00100000:3.0:1788845415.624977:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180102144 00000100:00100000:3.0:1788845415.625069:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:3.0:1788845415.625080:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:9689:x1875740180102144:12345-192.168.206.35@tcp:36:mkdir.0 00010000:00010000:3.0:1788845415.625153:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845415.625357:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df9742 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752243 expref: 6 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.625785:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:3.0:1788845415.625796:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845415.626122:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9861 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.626160:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9861 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.626170:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9861 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.626814:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9868 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.626824:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9868 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.626842:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9868 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845415.632579:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788845415.632599:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9861 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.632621:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9861 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.632630:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9861 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.632636:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ac00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845415.632641:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9861 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.632758:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9861 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.632777:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae90a6fb00) 00010000:00010000:3.0:1788845415.632780:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845415.632785:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9861 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.632791:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9861 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845415.632815:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000326df8c2 reply state 00000000050b0109 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9868 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845415.632845:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845415.632947:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:9689:x1875740180102144:12345-192.168.206.35@tcp:36:mkdir.0 Request processed in 7865us (8067us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788845415.632957:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00010000:00010000:3.0:1788845415.636202:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9868 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.636226:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9868 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.636233:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9868 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.636240:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845415.636245:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9868 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.636254:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9868 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.636271:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92ae90a6f800) 00010000:00010000:3.0:1788845415.636273:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845415.636277:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9868 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.636284:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9868 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845415.649091:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845415.649270:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180102272 00000100:00100000:3.0:1788845415.649279:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180102272 00000100:00100000:3.0:1788845415.649337:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:3.0:1788845415.649478:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:9691:x1875740180102272:12345-192.168.206.35@tcp:101:chmod.0 00010000:00010000:3.0:1788845415.649499:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845415.649520:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df986f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077522c8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.649786:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9876 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.649800:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.649812:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845415.649847:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788845415.649851:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845415.649892:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.649916:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df986f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522c8 expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.650193:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9876 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522c8 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.650203:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae90a6f800) 00010000:00010000:3.0:1788845415.650206:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788845415.650209:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748ac00, rc 0) 00000100:00100000:3.0:1788845415.650378:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:9691:x1875740180102272:12345-192.168.206.35@tcp:101:chmod.0 Request processed in 891us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845415.650393:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:0.0:1788845415.655123:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845415.655669:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180102528 00000100:00100000:3.0:1788845415.655678:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180102528 00000100:00100000:3.0:1788845415.655772:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:3.0:1788845415.655782:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+7:9691:x1875740180102528:12345-192.168.206.35@tcp:36:chmod.0 00010000:00010000:3.0:1788845415.655833:0:8176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845415.655855:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9876 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522c8 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.655874:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae90a6f800) 00010000:00010000:3.0:1788845415.655885:0:8176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845415.655910:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6df987d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.655923:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6df987d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.655932:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6df987d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845415.656265:0:8176:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac3e47dc reply state 00000000fcc30705 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6df987d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845415.656277:0:8176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788845415.656284:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788845415.656383:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+8:9691:x1875740180102528:12345-192.168.206.35@tcp:36:chmod.0 Request processed in 582us (1251us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788845415.656391:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 17 00010000:00010000:2.0:1788845415.658608:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6df987d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.658627:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6df987d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.658634:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6df987d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.658641:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845415.658645:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6df987d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.658724:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6df987d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.658741:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae90a6fb00) 00010000:00010000:2.0:1788845415.658744:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788845415.658748:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6df987d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.658753:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6df987d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845415.678171:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845415.678724:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180102656 00000100:00100000:3.0:1788845415.678735:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180102656 00000100:00100000:3.0:1788845415.678833:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:3.0:1788845415.678844:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:9693:x1875740180102656:12345-192.168.206.35@tcp:101:chown.0 00010000:00010000:3.0:1788845415.678868:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845415.678892:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077522cf expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.678967:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df988b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.678981:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df988b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.678994:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df988b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845415.679034:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788845415.679038:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845415.679078:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df988b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.679107:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522cf expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.679125:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df988b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522cf expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.679155:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae90a6f800) 00010000:00010000:3.0:1788845415.679158:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788845415.679183:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b000, rc 0) 00000100:00100000:3.0:1788845415.679257:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+8:9693:x1875740180102656:12345-192.168.206.35@tcp:101:chown.0 Request processed in 410us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845415.679264:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:3.0:1788845415.681399:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845415.681494:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180102784 00000100:00100000:1.0:1788845415.681503:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180102784 00000100:00100000:1.0:1788845415.681560:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:1.0:1788845415.681571:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+8:9693:x1875740180102784:12345-192.168.206.35@tcp:101:chown.0 00010000:00010000:1.0:1788845415.681589:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845415.681607:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df9892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077522d6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681688:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df9899 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681701:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df9899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681710:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df9899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681725:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681732:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681739:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681843:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df98a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681852:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df98a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681859:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df98a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845415.681887:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845415.681890:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845415.681910:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df98a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681947:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df9899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681954:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df9899 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681961:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df9899 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681967:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52a00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845415.681971:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df9899 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681979:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df9899 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.681992:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae90a6f800) 00010000:00010000:1.0:1788845415.681995:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845415.681999:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df9899 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.682005:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df9899 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.682018:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.682024:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.682030:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.682041:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845415.682044:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.682050:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.682059:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845415.682061:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845415.682063:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.682068:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.682099:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df9892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522d6 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.682111:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df98a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522d6 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.682117:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:1.0:1788845415.682119:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845415.682122:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a53600, rc 0) 00000100:00100000:1.0:1788845415.682191:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+9:9693:x1875740180102784:12345-192.168.206.35@tcp:101:chown.0 Request processed in 622us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845415.682198:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:0.0:1788845415.684893:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845415.684977:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180103040 00000100:00100000:3.0:1788845415.684986:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180103040 00000100:00100000:3.0:1788845415.685044:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:3.0:1788845415.685054:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+9:9693:x1875740180103040:12345-192.168.206.35@tcp:36:chown.0 00010000:00010000:3.0:1788845415.685107:0:8176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845415.685129:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df98a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522d6 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.685181:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:3.0:1788845415.685191:0:8176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845415.685216:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df98ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.685229:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df98ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.685238:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df98ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788845415.729236:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788845415.729422:0:8176:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055b46b60 reply state 000000009d43a718 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df98ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845415.729438:0:8176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788845415.729452:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1788845415.729591:0:8176:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788845415.729615:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+7:9693:x1875740180103040:12345-192.168.206.35@tcp:36:chown.0 Request processed in 44559us (44730us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788845415.729623:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00010000:00010000:0.0:1788845415.729781:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df98ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.729790:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df98ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.729797:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df98ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.729803:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ac00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845415.729808:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df98ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.729815:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df98ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.729829:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae90a6f900) 00010000:00010000:0.0:1788845415.729832:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788845415.729837:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df98ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.729843:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df98ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845415.764695:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845415.765969:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180103168 00000100:00100000:3.0:1788845415.765984:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180103168 00000100:00100000:3.0:1788845415.766109:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:3.0:1788845415.766120:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:9694:x1875740180103168:12345-192.168.206.35@tcp:101:touch.500 00010000:00010000:3.0:1788845415.766155:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845415.766490:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df98b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077522dd expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788845415.769971:0:5817:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3429us 00010000:00010000:1.0:1788845415.791696:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.791720:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.791733:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.791751:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.791758:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.791764:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792581:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df98ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792666:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df98ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792678:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df98ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845415.792705:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845415.792709:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845415.792749:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df98ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792762:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792775:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792782:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792788:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a53800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845415.792793:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792800:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792812:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae90a6f800) 00010000:00010000:1.0:1788845415.792815:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845415.792818:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792824:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792837:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792843:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792848:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792853:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845415.792862:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792868:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792877:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92ae93b8e700) 00010000:00010000:1.0:1788845415.792879:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845415.792882:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792889:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792929:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df98b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522dd expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792944:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df98ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522dd expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.792951:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845415.792953:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788845415.792956:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a52a00, rc 0) 00000100:00100000:1.0:1788845415.793179:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:9694:x1875740180103168:12345-192.168.206.35@tcp:101:touch.500 Request processed in 27059us (28495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845415.793189:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:0.0:1788845415.797235:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845415.797322:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180103424 00000100:00100000:1.0:1788845415.797331:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180103424 00000100:00100000:1.0:1788845415.797493:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:1.0:1788845415.797568:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:9694:x1875740180103424:12345-192.168.206.35@tcp:101:touch.500 00010000:00010000:1.0:1788845415.797606:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845415.797626:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077522e4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.798219:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.798237:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.798247:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.798309:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df98df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.798317:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df98df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.798325:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df98df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845415.800937:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788845415.801243:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df98e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.801259:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df98e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.801270:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df98e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.801318:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.801326:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.801332:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.801338:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a53800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845415.801342:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.801351:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.801390:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845415.801394:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845415.801398:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.801405:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df98d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845415.801419:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cc8150b reply state 000000009329d47d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df98df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845415.801428:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788845415.801462:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522e4 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.801488:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df98e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522e4 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.801497:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ae93b8ea00) 00010000:00010000:1.0:1788845415.801499:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845415.801501:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a53600, rc 0) 00000100:00100000:1.0:1788845415.802237:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+10:9694:x1875740180103424:12345-192.168.206.35@tcp:101:touch.500 Request processed in 4730us (5009us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788845415.802248:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 22 00010000:00010000:0.0:1788845415.804459:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df98df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.804477:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df98df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.804484:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df98df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.804490:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a53c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845415.804495:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df98df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.804503:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df98df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.804591:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7c3c31ce (ffff92ae93b8e700) 00010000:00010000:0.0:1788845415.804594:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845415.804599:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df98df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.804606:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df98df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845415.806667:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845415.806987:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180103680 00000100:00100000:2.0:1788845415.806997:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180103680 00000100:00100000:2.0:1788845415.807061:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:2.0:1788845415.807070:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+9:9694:x1875740180103680:12345-192.168.206.35@tcp:36:touch.500 00010000:00010000:2.0:1788845415.807129:0:8176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845415.807165:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df98e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522e4 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.807186:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ae93b8ea00) 00010000:00010000:2.0:1788845415.807195:0:8176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845415.807241:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df98f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.807254:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df98f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.807263:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df98f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845415.807498:0:8176:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa3e7534 reply state 000000009690bdcf transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df98f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845415.807586:0:8176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845415.807795:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+10:9694:x1875740180103680:12345-192.168.206.35@tcp:36:touch.500 Request processed in 724us (1139us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788845415.807802:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00010000:00010000:0.0:1788845415.811000:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df98f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.811022:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df98f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.811048:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df98f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.811055:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845415.811060:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df98f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.811079:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df98f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.811096:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:0.0:1788845415.811099:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845415.811103:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df98f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845415.811109:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df98f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845415.813182:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845415.813471:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180103808 00000100:00100000:1.0:1788845415.813481:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180103808 00000100:00100000:1.0:1788845415.813537:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:1.0:1788845415.813547:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+9:9694:x1875740180103808:12345-192.168.206.35@tcp:101:touch.500 00010000:00010000:1.0:1788845415.813571:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845415.813592:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077522eb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.813855:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522eb expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.813881:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522eb expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.813902:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ae93b8e900) 00010000:00010000:1.0:1788845415.813905:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845415.813925:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a52400, rc 0) 00000100:00100000:1.0:1788845415.813987:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+10:9694:x1875740180103808:12345-192.168.206.35@tcp:101:touch.500 Request processed in 440us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845415.813994:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:2.0:1788845415.817328:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845415.817422:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180103936 00000100:00100000:0.0:1788845415.817432:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180103936 00000100:00100000:1.0:1788845415.819154:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:1.0:1788845415.819165:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875740180103936:12345-192.168.206.35@tcp:8:touch.500 00010000:00080000:1.0:1788845415.819200:0:6656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:1.0:1788845415.819231:0:6656:0:(genops.c:1385:class_connect()) connect: client 704fd1fa-8fb6-403c-867f-b875231088ec, cookie 0xd8041b54d6df9902 00002000:00100000:1.0:1788845415.819244:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 704fd1fa-8fb6-403c-867f-b875231088ec/ffff92aeae46c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788845415.819268:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788845415.819565:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788845415.819597:0:6656:0:(import.c:65:import_set_state_nolock()) ffff92aeae46a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845415.819671:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2371:x1875740180103936:12345-192.168.206.35@tcp:8:touch.500 Request processed in 505us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845415.819679:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:1.0:1788845415.825127:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845415.825394:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180104064 00000100:00100000:0.0:1788845415.825404:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180104064 00000100:00100000:0.0:1788845415.825473:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:0.0:1788845415.825484:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:0:x1875740180104064:12345-192.168.206.35@tcp:2:touch.500 00000100:00080000:1.0:1788845415.826342:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788845415.858698:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1788845415.858733:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00000100:00100000:1.0:1788845415.859032:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+5:0:x1875740180104064:12345-192.168.206.35@tcp:2:touch.500 Request processed in 33546us (33914us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788845415.859039:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:2.0:1788845415.861208:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845415.861304:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180104320 00000100:00100000:3.0:1788845415.861313:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180104320 00000100:00100000:3.0:1788845415.861429:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:3.0:1788845415.861439:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+10:9694:x1875740180104320:12345-192.168.206.35@tcp:35:touch.500 00000100:00100000:3.0:1788845415.861810:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+11:9694:x1875740180104320:12345-192.168.206.35@tcp:35:touch.500 Request processed in 373us (612us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788845415.861816:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:2.0:1788845415.874781:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845415.874858:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180104448 00000100:00100000:1.0:1788845415.874869:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180104448 00000100:00100000:1.0:1788845415.874936:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:1.0:1788845415.874947:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+11:9695:x1875740180104448:12345-192.168.206.35@tcp:101:rm.0 00010000:00010000:1.0:1788845415.874970:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845415.875007:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077522f2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.875073:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df9910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.875087:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df9910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.875097:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df9910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845415.875132:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845415.875135:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845415.876705:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df9910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.876746:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522f2 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.876769:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df9910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522f2 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.876778:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845415.876780:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845415.876783:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a53800, rc 0) 00000100:00100000:1.0:1788845415.876860:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+12:9695:x1875740180104448:12345-192.168.206.35@tcp:101:rm.0 Request processed in 1914us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845415.876869:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:1.0:1788845415.884130:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845415.886060:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180104704 00000100:00100000:2.0:1788845415.886076:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180104704 00000100:00100000:2.0:1788845415.886166:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:2.0:1788845415.886176:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+12:9695:x1875740180104704:12345-192.168.206.35@tcp:101:rm.0 00010000:00010000:2.0:1788845415.886194:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845415.886215:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9917 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077522f9 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845415.886308:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788845415.886489:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9917 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522f9 expref: 14 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.886502:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae90a6f800) 00010000:00010000:2.0:1788845415.886505:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845415.886510:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9917 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522f9 expref: 14 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.886541:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1600, rc 0) 00000100:00100000:2.0:1788845415.886626:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+13:9695:x1875740180104704:12345-192.168.206.35@tcp:101:rm.0 Request processed in 451us (2508us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788845415.886649:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:2.0:1788845415.890981:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845415.891413:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180104832 00000100:00100000:3.0:1788845415.891424:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180104832 00000100:00100000:3.0:1788845415.891485:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:3.0:1788845415.891496:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+13:9695:x1875740180104832:12345-192.168.206.35@tcp:37:rm.0 00000100:00100000:3.0:1788845415.897458:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+13:9695:x1875740180104832:12345-192.168.206.35@tcp:37:rm.0 Request processed in 5950us (6475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845415.897472:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:0.0:1788845415.900569:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845415.900672:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180105088 00000100:00100000:1.0:1788845415.900682:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180105088 00000100:00100000:1.0:1788845415.900741:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:1.0:1788845415.900751:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+13:9695:x1875740180105088:12345-192.168.206.35@tcp:35:rm.0 00000100:00100000:1.0:1788845415.901324:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+14:9695:x1875740180105088:12345-192.168.206.35@tcp:35:rm.0 Request processed in 571us (765us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788845415.901332:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:2.0:1788845415.904465:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845415.904616:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180105344 00000100:00100000:1.0:1788845415.904625:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180105344 00000100:00100000:1.0:1788845415.904685:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:1.0:1788845415.904695:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+14:9695:x1875740180105344:12345-192.168.206.35@tcp:101:rm.0 00010000:00010000:1.0:1788845415.904717:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845415.904736:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9925 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752300 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.904951:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df992c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.905072:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df992c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.905086:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df992c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845415.905098:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788845415.905302:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9925 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752300 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.905323:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df992c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752300 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.905349:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845415.905352:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788845415.905356:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a53c00, rc 0) 00000100:00100000:1.0:1788845415.905698:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+16:9695:x1875740180105344:12345-192.168.206.35@tcp:101:rm.0 Request processed in 1003us (1245us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788845415.905706:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:0.0:1788845415.908902:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845415.909119:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180105472 00000100:00100000:1.0:1788845415.909129:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180105472 00000100:00100000:1.0:1788845415.909312:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:1.0:1788845415.909323:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+16:9695:x1875740180105472:12345-192.168.206.35@tcp:41:rm.0 00000004:00000024:1.0:1788845415.909789:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788845415.909863:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+16:9695:x1875740180105472:12345-192.168.206.35@tcp:41:rm.0 Request processed in 541us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845415.909871:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:0.0:1788845415.912449:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845415.912533:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180105600 00000100:00100000:2.0:1788845415.912543:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180105600 00000100:00100000:2.0:1788845415.912730:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:2.0:1788845415.912742:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+16:9695:x1875740180105600:12345-192.168.206.35@tcp:101:rm.0 00010000:00010000:2.0:1788845415.912761:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845415.912779:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df993a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752307 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.912848:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9941 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.912862:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9941 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.912872:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9941 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.912886:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.912894:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.912900:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913026:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6df994f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913052:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6df994f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913059:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6df994f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845415.913089:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788845415.913093:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845415.913111:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6df994f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913122:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6df994f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913130:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9941 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913147:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9941 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913154:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9941 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913160:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1a00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845415.913164:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9941 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913171:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9941 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913194:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:2.0:1788845415.913197:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845415.913207:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9941 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913213:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9941 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913228:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913234:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9948 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913240:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913245:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845415.913248:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913254:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913261:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7c3c31ce (ffff92ae931baf00) 00010000:00010000:2.0:1788845415.913264:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845415.913266:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9948 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913272:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9948 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913301:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df993a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752307 expref: 18 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913327:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6df994f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752307 expref: 17 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.913334:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ae93b8e900) 00010000:00010000:2.0:1788845415.913336:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845415.913339:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0400, rc 0) 00000100:00100000:2.0:1788845415.913447:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+17:9695:x1875740180105600:12345-192.168.206.35@tcp:101:rm.0 Request processed in 708us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845415.913454:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:2.0:1788845415.918487:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845415.922263:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180105856 00000100:00100000:1.0:1788845415.922294:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180105856 00000100:00100000:1.0:1788845415.922457:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:1.0:1788845415.922473:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+17:9695:x1875740180105856:12345-192.168.206.35@tcp:36:rm.0 00010000:00010000:1.0:1788845415.922527:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788845415.922553:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6df994f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752307 expref: 17 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.922578:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6df98fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522eb expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.922613:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ae93b8e900) 00010000:00010000:1.0:1788845415.922631:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6df9910 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522f2 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.922641:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845415.922644:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845415.922664:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9956 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.922676:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.922686:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.922700:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df995d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.922707:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df995d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.922714:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df995d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.922830:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9964 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.922839:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9964 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.922857:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9964 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788845415.923884:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788845415.923896:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 225143533041ns, next at 226143530911ns, rc = 0 00010000:00010000:1.0:1788845415.924196:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df996b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924209:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df996b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924218:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df996b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924226:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df996b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924232:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df996b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924238:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df996b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924298:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788845415.924317:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9964 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924323:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9964 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924329:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9964 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924340:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845415.924344:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9964 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924350:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9964 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924393:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ae93b8ee00) 00010000:00010000:1.0:1788845415.924397:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788845415.924400:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9964 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924406:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6df9964 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924424:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924429:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9956 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924434:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9956 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924438:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a53600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845415.924440:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9956 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924446:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9956 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924461:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845415.924463:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845415.924466:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9956 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.924471:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53600/0xd8041b54d6df9956 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845415.924479:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5b6feb5 reply state 0000000027954fb6 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df995d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845415.924488:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788845415.924566:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+16:9695:x1875740180105856:12345-192.168.206.35@tcp:36:rm.0 Request processed in 2093us (6090us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788845415.924574:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 30 00010000:00010000:3.0:1788845415.927431:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845415.927446:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df996b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.927458:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845415.927462:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df996b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.927496:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df996b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.927514:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ae93b8ee00) 00010000:00010000:3.0:1788845415.927517:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788845415.927521:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df996b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.927526:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df996b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.927634:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845415.927637:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845415.927639:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845415.927930:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845415.928162:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180106112 00000100:00100000:2.0:1788845415.928171:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180106112 00010000:00010000:3.0:1788845415.928173:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df995d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.928181:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df995d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.928188:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df995d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.928194:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a53200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845415.928197:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df995d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.928203:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df995d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.928214:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7c3c31ce (ffff92ae93b8e300) 00010000:00010000:3.0:1788845415.928217:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845415.928220:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df995d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845415.928236:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6df995d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845415.928316:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:2.0:1788845415.928327:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+15:9695:x1875740180106112:12345-192.168.206.35@tcp:35:rm.0 00000100:00100000:2.0:1788845415.928625:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+16:9695:x1875740180106112:12345-192.168.206.35@tcp:35:rm.0 Request processed in 299us (698us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788845415.928632:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:0.0:1788845415.930647:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845415.930738:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180106368 00000100:00100000:1.0:1788845415.930747:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180106368 00000100:00100000:1.0:1788845415.930801:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:1.0:1788845415.930819:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+16:9695:x1875740180106368:12345-192.168.206.35@tcp:36:rm.0 00010000:00010000:1.0:1788845415.930869:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788845415.930891:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6df992c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752300 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.930913:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6df98ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522dd expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.930926:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845415.930940:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df988b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522cf expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.930966:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae90a6f800) 00010000:00010000:1.0:1788845415.930974:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845415.930999:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9972 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.931011:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9972 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.931021:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9972 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.931033:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9979 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.931040:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9979 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.931053:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9979 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.931329:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9980 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.931338:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9980 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.931346:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9980 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845415.933519:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788845415.933547:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9980 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933566:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9980 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933573:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9980 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933579:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845415.933584:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9980 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933592:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9980 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933606:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:1.0:1788845415.933609:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788845415.933614:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9980 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933619:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9980 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933644:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9972 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933651:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9972 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933656:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9972 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933661:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845415.933670:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9972 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933677:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9972 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933686:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8ea00) 00010000:00010000:1.0:1788845415.933688:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845415.933690:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9972 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845415.933696:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9972 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845415.933709:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa62c0f4 reply state 0000000006ddab89 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9979 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845415.933718:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788845415.933867:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+15:9695:x1875740180106368:12345-192.168.206.35@tcp:36:rm.0 Request processed in 3046us (3225us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788845415.933875:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 31 00010000:00010000:2.0:1788845415.935397:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9979 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.935413:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9979 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.935419:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9979 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.935443:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845415.935447:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9979 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.935453:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9979 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.935466:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92ae93b8e700) 00010000:00010000:2.0:1788845415.935469:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845415.935474:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9979 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845415.935480:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9979 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845416.031034:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189571584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845416.031112:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845416.031278:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189571584 00000100:00100000:1.0:1788845416.031286:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189571584 00000100:00100000:1.0:1788845416.031355:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788845416.031382:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189571584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845416.031404:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845416.031450:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189571584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845416.031458:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788845416.031635:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ae9eac2d80 x1875740189571584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845416.031654:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189571584:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788845416.284586:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845417.312962:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845418.331634:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788845418.930218:0:11575:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788845419.356802:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788845419.736932:0:11623:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd81b679d0 20000000:00000080:3.0:1788845419.736953:0:11623:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92aeb95dfc00 uarg=0000000000000000 20000000:01000000:3.0:1788845419.736994:0:11623:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788845419.737001:0:11623:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788845419.737006:0:11623:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788845419.738403:0:11624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788845419.738523:0:11623:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788845419.742870:0:11623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788845419.742927:0:11623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788845419.742981:0:11623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788845419.742999:0:11623:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788845419.743017:0:11623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.744670:0:11623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae89a52e00/0xd8041b54d6df9830 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9829 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.744680:0:11623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df983e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9837 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.744686:0:11623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6df984c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df9845 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.744695:0:11623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aeb748a600/0xd8041b54d6df9853 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522ba expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.744702:0:11623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aeb748a200/0xd8041b54d6df985a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077522c1 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.744708:0:11623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.744752:0:11623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aeb748a200/0xd8041b54d6df985a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522c1 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.744767:0:11623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92aeb748a200/0xd8041b54d6df985a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522c1 expref: 12 pid: 5811 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845419.744803:0:11623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11623:1875740189571712:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845419.744954:0:11623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aeb748a600/0xd8041b54d6df9853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522ba expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.744963:0:11623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92aeb748a600/0xd8041b54d6df9853 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522ba expref: 12 pid: 5812 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845419.744972:0:11623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11623:1875740189571840:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845419.745008:0:11623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6df984c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df9845 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.745016:0:11623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6df984c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df9845 expref: 18 pid: 5812 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845419.745255:0:11623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc784a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11623:1875740189571968:0@lo:104: 00000100:00100000:1.0:1788845419.745295:0:11623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845419.745344:0:11623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df983e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df9837 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.745352:0:11623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df983e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df9837 expref: 18 pid: 5810 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845419.745377:0:11623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7faad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11623:1875740189572096:0@lo:104: 00000100:00100000:1.0:1788845419.745404:0:11623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845419.745436:0:11623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae89a52e00/0xd8041b54d6df9830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6df9829 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.745445:0:11623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ae89a52e00/0xd8041b54d6df9830 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6df9829 expref: 18 pid: 5812 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845419.745465:0:7601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189571968 00000100:00100000:3.0:1788845419.745473:0:7601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189571968 00000100:00100000:3.0:1788845419.745530:0:7601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189572096 00000100:00100000:3.0:1788845419.745534:0:7601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189572096 00000100:00100000:3.0:1788845419.745549:0:7601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788845419.745560:0:7601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:11623:x1875740189571968:12345-0@lo:104: 00000100:00100000:2.0:1788845419.745566:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788845419.745574:0:7601:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845419.745581:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:11623:x1875740189572096:12345-0@lo:104: 00010000:00010000:2.0:1788845419.745595:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845419.745639:0:7601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845419.745645:0:7601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:11623:x1875740189571968:12345-0@lo:104: Request processed in 88us (350us total) trans 0 rc 0/0 00010000:00010000:2.0:1788845419.745646:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788845419.745656:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+4:11623:x1875740189572096:12345-0@lo:104: Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845419.745668:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788845419.745675:0:7601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788845419.745694:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788845419.745700:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.745714:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0600 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845419.745719:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.745727:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845419.745735:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845419.745741:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845419.745768:0:8417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.745774:0:8417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845419.745795:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.745802:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0600/0xd8041b54d6df9845 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df984c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.745815:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845419.745818:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.745824:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1ee00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845419.745826:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.745843:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845419.745849:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845419.745854:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845419.745868:0:8417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.745874:0:8417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845419.745901:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.745909:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ee00/0xd8041b54d6df9837 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df983e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.745919:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845419.745921:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845419.745922:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845419.745929:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845419.745941:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189572352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845419.745971:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845419.746005:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845419.746013:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189572480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845419.746049:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845419.746061:0:11623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7fa8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11623:1875740189572224:0@lo:104: 00000100:00100000:2.0:1788845419.746081:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189572352 00000100:00100000:2.0:1788845419.746086:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189572352 00000100:00100000:1.0:1788845419.746092:0:11623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845419.746104:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6df984c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9845 expref: 19 pid: 5812 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845419.746106:0:11623:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb96d4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845419.746142:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189572480 00000100:00100000:2.0:1788845419.746145:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189572480 00000100:00100000:0.0:1788845419.746156:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1788845419.746158:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df983e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9837 expref: 20 pid: 5810 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845419.746165:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc896680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+20:3284:x1875740189572352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845419.746174:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788845419.746174:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788845419.746180:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc895880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+20:3286:x1875740189572480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845419.746180:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6df984c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9845 expref: 20 pid: 5812 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.746186:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845419.746189:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df983e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9837 expref: 20 pid: 5810 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845419.746190:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6df984c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df9845 expref: 20 pid: 5812 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.746197:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df983e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df9837 expref: 20 pid: 5810 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845419.746221:0:11623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc784a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11623:1875740189571968:0@lo:104: 00000100:00100000:1.0:1788845419.746232:0:11623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7faad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11623:1875740189572096:0@lo:104: 00010000:00010000:0.0:1788845419.746292:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6df984c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df9845 expref: 20 pid: 5812 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845419.746304:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845419.746344:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc896680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189572352:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845419.746350:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788845419.746439:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788845419.746450:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189572224 00000100:00100000:1.0:1788845419.746453:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189572224 00000100:00100000:1.0:1788845419.746489:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788845419.746495:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7498450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:11623:x1875740189572224:12345-0@lo:104: 00010000:00010000:1.0:1788845419.746502:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.746536:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788845419.746541:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7498450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+3:11623:x1875740189572224:12345-0@lo:104: Request processed in 47us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845419.746547:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788845419.746595:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845419.746600:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845419.746601:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189572352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788845419.746607:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1c00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:1.0:1788845419.746610:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.746622:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845419.746641:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845419.746646:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845419.746657:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df983e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df9837 expref: 18 pid: 5810 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.746666:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845419.746670:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.746675:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845419.746687:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845419.746691:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc895880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:3286:x1875740189572480:12345-0@lo:103:ldlm_bl.0 Request processed in 511us (642us total) trans 0 rc 0/0 00010000:00010000:1.0:1788845419.746694:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1c00/0xd8041b54d6df9829 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6df9830 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845419.746697:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1788845419.746708:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845419.746710:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845419.746711:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845419.746719:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189572608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788845419.746726:0:11623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7fa8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11623:1875740189572224:0@lo:104: 00000100:00100000:2.0:1788845419.746743:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845419.746822:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189572480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788845419.746830:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189572608 00000100:00100000:1.0:1788845419.746834:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189572608 00010000:00010000:1.0:1788845419.746849:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae89a52e00/0xd8041b54d6df9830 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9829 expref: 17 pid: 5812 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845419.746870:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788845419.746876:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:3286:x1875740189572608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788845419.746884:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845419.746887:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae89a52e00/0xd8041b54d6df9830 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6df9829 expref: 17 pid: 5812 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.746906:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae89a52e00/0xd8041b54d6df9830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6df9829 expref: 17 pid: 5812 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.746917:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae89a52e00/0xd8041b54d6df9830 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6df9829 expref: 17 pid: 5812 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.746926:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845419.746967:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3286:x1875740189572608:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845419.746973:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788845419.747148:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189572608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788845419.749191:0:11623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11623:1875740189571712:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845419.749207:0:11623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11623:1875740189571840:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845419.749243:0:11623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845419.750566:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845419.750676:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180106496 00000100:00100000:2.0:1788845419.750699:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180106496 00010000:00010000:2.0:1788845419.750733:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aeb748a200/0xd8041b54d6df985a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522c1 expref: 13 pid: 5811 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845419.750775:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:2.0:1788845419.750784:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae296a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a83c90f8-270b-4823-9416-881b40e3aa44+13:2372:x1875740180106496:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845419.750797:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845419.750803:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aeb748a200/0xd8041b54d6df985a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522c1 expref: 13 pid: 5811 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.750813:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aeb748a200/0xd8041b54d6df985a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522c1 expref: 13 pid: 5811 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.750830:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb748a200/0xd8041b54d6df985a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522c1 expref: 13 pid: 5811 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.750843:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845419.751832:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae296a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a83c90f8-270b-4823-9416-881b40e3aa44+12:2372:x1875740180106496:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 1044us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845419.751844:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:0.0:1788845419.753567:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845419.753863:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180106624 00000100:00100000:3.0:1788845419.753873:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180106624 00010000:00010000:2.0:1788845419.754088:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aeb748a600/0xd8041b54d6df9853 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522ba expref: 12 pid: 5812 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845419.754212:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:2.0:1788845419.754223:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae296680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a83c90f8-270b-4823-9416-881b40e3aa44+12:2372:x1875740180106624:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845419.754237:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845419.754245:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aeb748a600/0xd8041b54d6df9853 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522ba expref: 12 pid: 5812 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754281:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aeb748a600/0xd8041b54d6df9853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522ba expref: 12 pid: 5812 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754299:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb748a600/0xd8041b54d6df9853 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077522ba expref: 12 pid: 5812 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754318:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754326:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754628:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754638:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754645:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754652:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754658:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09c00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845419.754662:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754669:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754705:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845419.754716:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845419.754776:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae296680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a83c90f8-270b-4823-9416-881b40e3aa44+11:2372:x1875740180106624:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 554us (1218us total) trans 0 rc 0/0 00010000:00010000:1.0:1788845419.754935:0:11623:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.754946:0:11623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845419.755126:0:11623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fc09c00/0xd8041b54d6df9987 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845419.756346:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:0.0:1788845420.257581:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845420.257636:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845420.257689:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845420.257736:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180106880 00000100:00100000:3.0:1788845420.257747:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180106880 00000100:00100000:0.0:1788845420.257748:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845420.257781:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180107008 00000100:00100000:0.0:1788845420.257786:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180107008 00000100:00100000:3.0:1788845420.257828:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180107136 00000100:00100000:3.0:1788845420.257832:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180107136 00000100:00100000:0.0:1788845420.257839:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:0.0:1788845420.257862:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb4e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180107008:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845420.257863:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:3.0:1788845420.257876:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+14:2373:x1875740180106880:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845420.257947:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb4e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180107008:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 98us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845420.257968:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:1.0:1788845420.258172:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:1.0:1788845420.258185:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180107136:12345-192.168.206.35@tcp:400:kworker.0 00000100:00080000:2.0:1788845420.258289:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845420.258294:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845420.258304:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180106752 00000100:00100000:2.0:1788845420.258309:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180106752 00000100:00100000:2.0:1788845420.258339:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 238 00000100:00100000:2.0:1788845420.258346:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+11:2373:x1875740180106752:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845420.260552:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+14:2373:x1875740180106880:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 2664us (2971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845420.260565:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:1.0:1788845420.261168:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180107136:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 2983us (3527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845420.261193:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:2.0:1788845420.264253:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+11:2373:x1875740180106752:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 5890us (6551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845420.264268:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 238 00010000:00010000:2.0:1788845420.382070:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845420.635829:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189572736:0@lo:400:kworker.0 00000100:00100000:3.0:1788845420.636038:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845420.636331:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189572992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845420.636385:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845420.636431:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189572992 00000100:00100000:0.0:1788845420.636438:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189572992 00000100:00100000:0.0:1788845420.636490:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788845420.636498:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189572992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845420.636530:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845420.636582:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189572992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845420.636589:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788845420.636638:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb74ab800 x1875740189572992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845420.636656:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189572992:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788845420.636678:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845420.639986:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845420.640012:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189572864:0@lo:400:kworker.0 00000100:00100000:3.0:1788845420.640089:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845420.640226:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189572736 00000100:00100000:3.0:1788845420.640234:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189572736 00000100:00100000:1.0:1788845420.640404:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189572864 00000100:00100000:1.0:1788845420.640409:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189572864 00000100:00100000:1.0:1788845420.640450:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788845420.640459:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189572864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845420.640511:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189572864:12345-0@lo:400:kworker.0 Request processed in 54us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845420.640519:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788845420.640803:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788845420.640813:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3283:x1875740189572736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845420.640892:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189573376:0@lo:400:kworker.0 00000100:00100000:2.0:1788845420.640925:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845420.640947:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845420.640952:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189573248:0@lo:400:kworker.0 00000100:00100000:2.0:1788845420.640979:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845420.641026:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189572864:0@lo:400:kworker.0 00000100:00100000:3.0:1788845420.641037:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3283:x1875740189572736:12345-0@lo:400:kworker.0 Request processed in 224us (4997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845420.641045:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788845420.641053:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189572736:0@lo:400:kworker.0 00000100:00100000:2.0:1788845420.641087:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189573248 00000100:00100000:2.0:1788845420.641098:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189573248 00000100:00100000:1.0:1788845420.641143:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189573120:0@lo:400:kworker.0 00000100:00100000:1.0:1788845420.641183:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845420.641216:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189573376 00000100:00100000:1.0:1788845420.641220:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189573376 00000100:00100000:1.0:1788845420.641250:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788845420.641257:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189573376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845420.641295:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189573376:12345-0@lo:400:kworker.0 Request processed in 39us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845420.641326:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788845420.641355:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc894e00 x1875740189573376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845420.641385:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189573376:0@lo:400:kworker.0 00000100:00080000:1.0:1788845420.641419:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845420.641424:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845420.641447:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189573120 00000100:00100000:2.0:1788845420.641452:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189573120 00000100:00100000:1.0:1788845420.641452:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788845420.641466:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189573248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845420.641492:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788845420.641501:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189573120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845420.641510:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189573248:12345-0@lo:400:kworker.0 Request processed in 48us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845420.641526:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788845420.641546:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189573120:12345-0@lo:400:kworker.0 Request processed in 46us (361us total) trans 0 rc 0/0 00000100:00080000:1.0:1788845420.641548:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845420.641557:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788845420.641570:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189573248:0@lo:400:kworker.0 00000100:00100000:1.0:1788845420.641593:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189573120:0@lo:400:kworker.0 10000000:01000000:3.0:1788845420.891505:0:5814:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788845420.891514:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92aeb79e4000 from 7 10000000:01000000:3.0:1788845420.891520:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788845420.891571:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845420.891584:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845420.891596:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845420.891623:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189573504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788845420.891698:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845420.891814:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc2603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845420.894051:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189573504 00000100:00100000:2.0:1788845420.894067:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189573504 00000100:00100000:2.0:1788845420.894157:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788845420.894168:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:5814:x1875740189573504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845420.894469:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845420.894491:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df9995 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df998e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845420.894519:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df9995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df998e expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845420.894531:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df9995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df998e expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845420.894540:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0200, rc 0) 00000100:00100000:2.0:1788845420.894698:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189573504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 533us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845420.894706:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788845420.894972:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189573504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845420.894991:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845420.895051:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845420.895137:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189573632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845420.896507:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845420.896569:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc2603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845420.896628:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189573632 00000100:00100000:1.0:1788845420.896637:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189573632 00000100:00100000:1.0:1788845420.896691:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788845420.896700:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189573632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845420.897324:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189573632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 624us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845420.897333:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788845420.897880:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189573632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845420.897932:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189573760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845420.898047:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845420.898157:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc2603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845420.899038:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189573760 00000100:00100000:2.0:1788845420.899047:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189573760 00000100:00100000:2.0:1788845420.899104:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788845420.899138:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9176a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189573760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845420.899438:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9176a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189573760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 307us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845420.899446:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788845420.899727:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189573760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845420.902451:0:11636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11636:1875740189573888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845420.902546:0:11636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845420.902659:0:11636:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc268900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845420.903001:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189573888 00000100:00100000:1.0:1788845420.903008:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189573888 00000100:00100000:1.0:1788845420.903094:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788845420.903105:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:11636:x1875740189573888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845420.903356:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:11636:x1875740189573888:12345-0@lo:502:llog_process_th.0 Request processed in 252us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845420.903394:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788845420.903500:0:11636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11636:1875740189573888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845420.903530:0:11636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845420.903540:0:11636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845420.903543:0:11636:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788845420.903550:0:11636:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92aeb79e4000 00000020:00000080:2.0:1788845420.903552:0:11636:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788845420.903655:0:11636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc896a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11636:1875740189574016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845420.903691:0:11636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845420.905569:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189574016 00000100:00100000:2.0:1788845420.905586:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189574016 00000100:00100000:2.0:1788845420.905628:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788845420.905638:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:11636:x1875740189574016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845420.905875:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:11636:x1875740189574016:12345-0@lo:502:llog_process_th.0 Request processed in 239us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845420.905882:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788845420.905935:0:11636:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845420.905957:0:11636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc896a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11636:1875740189574016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845420.905987:0:11636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845420.905995:0:11636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845420.905997:0:11636:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788845420.906002:0:11636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788845420.906661:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788845420.906692:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788845420.906704:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845420.906717:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845420.906738:0:5814:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788845420.906740:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ae8fcc6800 from 7 10000000:01000000:1.0:1788845420.906743:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845420.906773:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845420.906781:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845420.906790:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845420.906811:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7faad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189574144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845420.906856:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845420.906885:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae90785a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788845420.906900:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189574144 00000100:00100000:1.0:1788845420.906904:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189574144 00000100:00100000:1.0:1788845420.906937:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788845420.906944:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:5814:x1875740189574144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845420.906954:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845420.906966:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc08600/0xd8041b54d6df99a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df999c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845420.906997:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc08600/0xd8041b54d6df99a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df999c expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845420.907007:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc08600/0xd8041b54d6df99a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df999c expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845420.907025:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08600, rc 0) 00000100:00100000:1.0:1788845420.907059:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189574144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845420.907066:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788845420.907101:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7faad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189574144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845420.907125:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845420.907489:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845420.907543:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7faad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189574272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845420.907568:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845420.907675:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845420.907901:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189574272 00000100:00100000:3.0:1788845420.907906:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189574272 00000100:00100000:3.0:1788845420.907985:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788845420.907995:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189574272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845420.908305:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189574272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845420.908312:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788845420.908481:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7faad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189574272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845420.908527:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc896a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189574400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845420.908571:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845420.908779:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fee06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845420.908879:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189574400 00000100:00100000:1.0:1788845420.908885:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189574400 00000100:00100000:1.0:1788845420.908912:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788845420.908921:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189574400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845420.909078:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189574400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845420.909084:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788845420.909137:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc896a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189574400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845420.909348:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7faaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11638:1875740189574528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845420.909407:0:11638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845420.909437:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189574528 00000100:00100000:1.0:1788845420.909441:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189574528 00000100:00100000:1.0:1788845420.909463:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788845420.909472:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:11638:x1875740189574528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845420.910284:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:11638:x1875740189574528:12345-0@lo:502:llog_process_th.0 Request processed in 810us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845420.910293:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788845420.910444:0:11638:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845420.910464:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7faaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11638:1875740189574528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788845420.910496:0:11638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845420.910505:0:11638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845420.910507:0:11638:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788845420.910514:0:11638:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92ae8fcc6800 00000020:00000080:1.0:1788845420.910518:0:11638:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788845420.910687:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7faaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11638:1875740189574656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845420.910963:0:11638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845420.910997:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189574656 00000100:00100000:1.0:1788845420.911002:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189574656 00000100:00100000:1.0:1788845420.911696:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788845420.911706:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:11638:x1875740189574656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845420.912469:0:11638:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845420.914312:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:11638:x1875740189574656:12345-0@lo:502:llog_process_th.0 Request processed in 2599us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845420.914326:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788845420.914429:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7faaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11638:1875740189574656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845420.914465:0:11638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845420.914474:0:11638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845420.914476:0:11638:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788845420.914483:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788845420.914637:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788845420.914650:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845420.914667:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845420.914677:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845420.914687:0:5814:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788845420.914689:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ae90de3800 from 7 10000000:01000000:0.0:1788845420.914692:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845420.914719:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845420.914728:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845420.914797:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845420.914821:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189574784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845420.914862:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845420.914893:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189574784 00000100:00100000:0.0:1788845420.914896:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc268d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845420.914899:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189574784 00000100:00100000:3.0:1788845420.914932:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788845420.914941:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:5814:x1875740189574784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845420.914954:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845420.914966:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb748be00/0xd8041b54d6df99b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6df99aa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845420.914986:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb748be00/0xd8041b54d6df99b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6df99aa expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845420.915006:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb748be00/0xd8041b54d6df99b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6df99aa expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845420.915013:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748be00, rc 0) 00000100:00100000:3.0:1788845420.915053:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189574784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845420.915059:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788845420.915279:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189574784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845420.915290:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845420.915298:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845420.915340:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189574912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845420.915406:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845420.915430:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189574912 00000100:00100000:0.0:1788845420.915430:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc268d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845420.915434:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189574912 00000100:00100000:3.0:1788845420.915452:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788845420.915459:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189574912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845420.915723:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189574912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845420.915730:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788845420.915873:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189574912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845420.915900:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189575040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845420.915937:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845420.915958:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc268d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845420.915965:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189575040 00000100:00100000:3.0:1788845420.915969:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189575040 00000100:00100000:3.0:1788845420.915997:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788845420.916003:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9167b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189575040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845420.916167:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9167b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:5814:x1875740189575040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845420.916174:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788845420.916533:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:5814:1875740189575040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845420.920359:0:11640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11640:1875740189575168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845420.920489:0:11640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845420.920524:0:11640:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc2683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845420.922019:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189575168 00000100:00100000:1.0:1788845420.922030:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189575168 00000100:00100000:1.0:1788845420.922149:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788845420.922159:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:11640:x1875740189575168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845420.922473:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:11640:x1875740189575168:12345-0@lo:502:llog_process_th.0 Request processed in 314us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845420.922481:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788845420.922566:0:11640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11640:1875740189575168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845420.922600:0:11640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845420.922611:0:11640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845420.922613:0:11640:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788845420.922622:0:11640:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92ae90de3800 00000020:00000080:0.0:1788845420.922625:0:11640:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788845420.922721:0:11640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11640:1875740189575296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845420.922779:0:11640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845420.924968:0:11640:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc2683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845420.925034:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189575296 00000100:00100000:2.0:1788845420.925536:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189575296 00000100:00100000:2.0:1788845420.925597:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788845420.925607:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:11640:x1875740189575296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845420.925888:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:11640:x1875740189575296:12345-0@lo:502:llog_process_th.0 Request processed in 281us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845420.925897:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788845420.925912:0:11640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:11640:1875740189575296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845420.925951:0:11640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845420.925960:0:11640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845420.925963:0:11640:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788845420.925970:0:11640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788845420.927682:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788845420.927717:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845420.927730:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845420.927742:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788845420.938816:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788845421.021756:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845421.022154:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180107264 00000100:00100000:1.0:1788845421.022164:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180107264 00000100:00100000:1.0:1788845421.022222:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 255 00000100:00100000:1.0:1788845421.022233:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae91678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+11:5614:x1875740180107264:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845421.022251:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845421.022267:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6df99b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce1200775230e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845421.022295:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6df99b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775230e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845421.022306:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6df99b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775230e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845421.022315:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08a00, rc 0) 00000100:00100000:1.0:1788845421.022555:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae91678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180107264:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 323us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845421.022562:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 255 00000100:00100000:0.0:1788845421.025278:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845421.025562:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180107392 00000100:00100000:1.0:1788845421.025636:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180107392 00000100:00100000:1.0:1788845421.025701:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 256 00000100:00100000:1.0:1788845421.025711:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180107392:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845421.026417:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180107392:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 705us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845421.026449:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 256 00000100:00100000:0.0:1788845421.029848:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845421.030312:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180107520 00000100:00100000:2.0:1788845421.030323:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180107520 00000100:00100000:2.0:1788845421.030446:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 257 00000100:00100000:2.0:1788845421.030457:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180107520:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845421.030694:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180107520:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 238us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845421.030702:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 257 00000100:00100000:0.0:1788845421.034900:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845421.035270:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180107648 00000100:00100000:1.0:1788845421.035280:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180107648 00000100:00100000:1.0:1788845421.035347:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 258 00000100:00100000:1.0:1788845421.035356:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+12:9964:x1875740180107648:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845421.035665:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+12:9964:x1875740180107648:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 308us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845421.035672:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 258 00000100:00100000:0.0:1788845421.039656:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845421.039810:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180107776 00000100:00100000:2.0:1788845421.039836:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180107776 00000100:00100000:2.0:1788845421.039890:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 259 00000100:00100000:2.0:1788845421.039899:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+12:9964:x1875740180107776:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845421.040165:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+12:9964:x1875740180107776:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 267us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845421.040174:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 259 00000100:00100000:3.0:1788845421.046895:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845421.047161:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180107904 00000100:00100000:2.0:1788845421.047171:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180107904 00000100:00100000:2.0:1788845421.047246:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 260 00000100:00100000:2.0:1788845421.047256:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+12:5614:x1875740180107904:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845421.047272:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845421.047289:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb7fd0600/0xd8041b54d6df99bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce12007752315 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845421.047315:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb7fd0600/0xd8041b54d6df99bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752315 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845421.047326:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb7fd0600/0xd8041b54d6df99bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752315 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845421.047335:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0600, rc 0) 00000100:00100000:2.0:1788845421.047444:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:5614:x1875740180107904:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 190us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845421.047451:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 260 00000100:00100000:0.0:1788845421.049357:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845421.049523:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180108032 00000100:00100000:1.0:1788845421.049533:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180108032 00000100:00100000:1.0:1788845421.049595:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 261 00000100:00100000:1.0:1788845421.049604:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:5614:x1875740180108032:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845421.050280:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:5614:x1875740180108032:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 672us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845421.050289:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 261 00000100:00100000:1.0:1788845421.059501:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845421.060149:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180108160 00000100:00100000:0.0:1788845421.060161:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180108160 00000100:00100000:0.0:1788845421.060265:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 262 00000100:00100000:0.0:1788845421.060275:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:5614:x1875740180108160:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845421.060569:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:5614:x1875740180108160:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 293us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845421.060577:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 262 00000100:00100000:2.0:1788845421.068307:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845421.068712:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180108288 00000100:00100000:1.0:1788845421.068723:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180108288 00000100:00100000:1.0:1788845421.068785:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 263 00000100:00100000:1.0:1788845421.068795:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:9967:x1875740180108288:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845421.069055:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:9967:x1875740180108288:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 260us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845421.069063:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 263 00000100:00100000:2.0:1788845421.076836:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845421.078003:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180108416 00000100:00100000:0.0:1788845421.078017:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180108416 00000100:00100000:0.0:1788845421.078091:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 264 00000100:00100000:0.0:1788845421.078102:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:9967:x1875740180108416:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788845421.078942:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:9967:x1875740180108416:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 836us (2585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845421.078953:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 264 00000004:00080000:1.0:1788845421.152147:0:8060:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 230371780721ns, next at 231371778081ns, rc = 0 00000100:00100000:1.0:1788845421.152342:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845421.152392:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189575424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845421.152464:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845421.152546:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189575424 00000100:00100000:1.0:1788845421.152554:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189575424 00000100:00100000:1.0:1788845421.152601:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788845421.152610:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189575424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845421.152642:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845421.152698:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189575424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845421.152705:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788845421.152747:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb7faa680 x1875740189575424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845421.152767:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189575424:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788845421.201789:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788845421.201825:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788845421.202148:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189575552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788845421.202229:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845421.202356:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189575552 00000100:00100000:3.0:1788845421.202394:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189575552 00000100:00100000:3.0:1788845421.202453:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788845421.202462:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189575552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788845421.202487:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788845421.202524:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f9d67, atime: 0x6a9f9d67, ctime: 0x6a9f9d67, blocks: 0x1 00010000:00010000:3.0:1788845421.202532:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6df99c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845421.202550:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=230s v=(0 0) 00010000:00010000:3.0:1788845421.202554:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845421.202570:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6df99c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845421.202587:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6df99c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845421.202598:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6df99c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845421.202606:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6df99c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845421.202623:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788845421.203186:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189575552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 717us (948us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788845421.203197:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788845421.203460:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92aebca14000/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788845421.203467:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189575552:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788845421.203574:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845421.203582:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6df99c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845421.203592:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845421.203596:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6df99c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845421.203606:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6df99c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845421.203625:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6df99c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845421.203633:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6df99c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845421.203654:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845421.203656:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845421.203657:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845421.403678:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788845421.980308:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788845422.427903:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845423.451609:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845424.475657:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845425.372214:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845425.372495:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845425.372548:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845425.372587:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845425.372612:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180108672 00000100:00100000:0.0:1788845425.372612:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180108800 00000100:00100000:3.0:1788845425.372620:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180108672 00000100:00100000:0.0:1788845425.372620:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180108800 00000100:00100000:1.0:1788845425.372687:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180108928 00000100:00100000:1.0:1788845425.372692:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180108928 00000100:00100000:2.0:1788845425.372775:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180108544 00000100:00100000:2.0:1788845425.372780:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180108544 00000100:00100000:2.0:1788845425.372821:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 265 00000100:00100000:2.0:1788845425.372830:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2372:x1875740180108544:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845425.372872:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:0.0:1788845425.372880:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2372:x1875740180108800:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845425.372908:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2372:x1875740180108544:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 79us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845425.372908:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2372:x1875740180108800:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845425.372916:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 265 00000100:00100000:0.0:1788845425.372916:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:3.0:1788845425.375789:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:3.0:1788845425.375808:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180108672:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845425.375884:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180108672:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 82us (3388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845425.375892:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00080000:0.0:1788845425.377561:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845425.377567:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00080000:0.0:1788845425.377572:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845425.377582:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180108928:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845425.377958:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180108928:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 380us (5409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845425.377966:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 84 00010000:00010000:2.0:1788845425.503421:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845425.756626:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189575680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845425.756703:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845425.756825:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189575680 00000100:00100000:2.0:1788845425.756834:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189575680 00000100:00100000:2.0:1788845425.756903:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788845425.756913:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189575680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845425.756946:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845425.756994:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189575680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845425.757001:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788845425.757040:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc894380 x1875740189575680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845425.757060:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189575680:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788845425.758052:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845425.758669:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189575808:0@lo:400:kworker.0 00000100:00100000:1.0:1788845425.758751:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845425.758851:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189575808 00000100:00100000:2.0:1788845425.758858:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189575808 00000100:00100000:2.0:1788845425.758910:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788845425.758919:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189575808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845425.759101:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189576192:0@lo:400:kworker.0 00000100:00100000:3.0:1788845425.759137:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845425.759169:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189576192 00000100:00100000:3.0:1788845425.759179:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189576192 00000100:00100000:3.0:1788845425.759214:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788845425.759220:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189576192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845425.759254:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189576192:12345-0@lo:400:kworker.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845425.759261:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788845425.759304:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189576192:0@lo:400:kworker.0 00000100:00080000:3.0:1788845425.759327:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845425.759344:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189575808:12345-0@lo:400:kworker.0 Request processed in 424us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845425.759348:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189575936:0@lo:400:kworker.0 00000100:00100000:2.0:1788845425.759357:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788845425.759413:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845425.759437:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189575936 00000100:00100000:3.0:1788845425.759443:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845425.759443:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189575936 00000100:00100000:3.0:1788845425.759451:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189576064:0@lo:400:kworker.0 00000100:00100000:3.0:1788845425.759477:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845425.759572:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189575808:0@lo:400:kworker.0 00000100:00100000:0.0:1788845425.759693:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189576320:0@lo:400:kworker.0 00000100:00100000:0.0:1788845425.759723:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845425.759754:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189576320 00000100:00100000:0.0:1788845425.759758:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189576320 00000100:00100000:0.0:1788845425.759788:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788845425.759795:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875740189576320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845425.759830:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875740189576320:12345-0@lo:400:kworker.0 Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845425.759837:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788845425.759867:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189576320:0@lo:400:kworker.0 00000100:00080000:0.0:1788845425.759894:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845425.759932:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189576064 00000100:00100000:2.0:1788845425.759936:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189576064 00000100:00100000:2.0:1788845425.759983:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788845425.759989:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189575936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845425.760026:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189575936:12345-0@lo:400:kworker.0 Request processed in 37us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845425.760032:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788845425.760044:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788845425.760050:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189576064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845425.760077:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189576064:12345-0@lo:400:kworker.0 Request processed in 27us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845425.760082:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788845425.760120:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189576064:0@lo:400:kworker.0 00000100:00100000:2.0:1788845425.760129:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189575936:0@lo:400:kworker.0 00000100:00080000:0.0:1788845425.760200:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845426.271493:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189576448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845426.271568:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845426.271655:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189576448 00000100:00100000:3.0:1788845426.271663:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189576448 00000100:00100000:3.0:1788845426.271713:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788845426.271723:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875740189576448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845426.271765:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845426.271809:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875740189576448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845426.271816:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788845426.271868:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189576448:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788845426.279001:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788845426.320447:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1788845426.524445:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845427.548209:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845428.572904:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845429.597098:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845430.492095:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845430.492137:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845430.492243:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845430.492288:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845430.492325:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180109312 00000100:00100000:2.0:1788845430.492334:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180109312 00000100:00100000:1.0:1788845430.492419:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180109056 00000100:00100000:1.0:1788845430.492426:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180109056 00000100:00100000:2.0:1788845430.492441:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:2.0:1788845430.492454:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180109312:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845430.492466:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 267 00000100:00100000:1.0:1788845430.492477:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:2374:x1875740180109056:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845430.492528:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:2374:x1875740180109056:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 52us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845430.492534:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 267 00000100:00100000:2.0:1788845430.492537:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180109312:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845430.492567:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00080000:1.0:1788845430.492586:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845430.493200:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180109184 00000100:00100000:0.0:1788845430.493207:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180109184 00000100:00100000:0.0:1788845430.493257:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180109440 00000100:00100000:0.0:1788845430.493272:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180109440 00000100:00100000:0.0:1788845430.493303:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:0.0:1788845430.493311:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180109184:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845430.493334:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 89 00000100:00100000:3.0:1788845430.493344:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2374:x1875740180109440:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845430.493351:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180109184:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 42us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845430.493358:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:3.0:1788845430.493396:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2374:x1875740180109440:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 55us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845430.493403:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 89 00000100:00080000:1.0:1788845430.494386:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788845430.619924:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845430.875629:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189576576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845430.875720:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845430.876002:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845430.876050:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189576576 00000100:00100000:2.0:1788845430.876069:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189576576 00000100:00080000:0.0:1788845430.876124:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845430.876137:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788845430.876146:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189576576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845430.876178:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845430.876229:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189576576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845430.876236:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788845430.876246:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189576832:0@lo:400:kworker.0 00000100:00100000:1.0:1788845430.876286:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788845430.876307:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc894700 x1875740189576576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845430.876322:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189576704:0@lo:400:kworker.0 00000100:00100000:0.0:1788845430.876328:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189576576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845430.876354:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845430.876515:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189576704 00000100:00100000:2.0:1788845430.876519:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189576832 00000100:00100000:0.0:1788845430.876521:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189576704 00000100:00100000:2.0:1788845430.876525:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189576832 00000100:00100000:0.0:1788845430.876563:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788845430.876567:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788845430.876572:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189576704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845430.876580:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189576832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845430.876753:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189577216:0@lo:400:kworker.0 00000100:00100000:1.0:1788845430.876914:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189576960:0@lo:400:kworker.0 00000100:00100000:2.0:1788845430.877122:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189576832:12345-0@lo:400:kworker.0 Request processed in 547us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845430.877130:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788845430.877178:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189576704:12345-0@lo:400:kworker.0 Request processed in 607us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845430.877179:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189576832:0@lo:400:kworker.0 00000100:00100000:0.0:1788845430.877192:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788845430.877199:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189576704:0@lo:400:kworker.0 00000100:00100000:2.0:1788845430.877232:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189577088:0@lo:400:kworker.0 00000100:00100000:2.0:1788845430.877261:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845430.877303:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189577088 00000100:00100000:0.0:1788845430.877308:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189577088 00000100:00100000:0.0:1788845430.877352:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788845430.877357:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875740189577088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788845430.877379:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845430.877520:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845430.877603:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189577216 00000100:00100000:2.0:1788845430.877607:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189577216 00000100:00100000:2.0:1788845430.877652:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788845430.877659:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189577216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845430.877717:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189577216:12345-0@lo:400:kworker.0 Request processed in 58us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845430.877723:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788845430.877786:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845430.877806:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788845430.877812:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92aebca14000, transno 4294967300 00000100:00100000:3.0:1788845430.877831:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189577216:0@lo:400:kworker.0 00000100:00100000:0.0:1788845430.877947:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875740189577088:12345-0@lo:400:kworker.0 Request processed in 589us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845430.877954:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788845430.877985:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189577088:0@lo:400:kworker.0 00000100:00100000:1.0:1788845430.878243:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845430.878335:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189576960 00000100:00100000:0.0:1788845430.878345:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189576960 00000100:00080000:3.0:1788845430.878374:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845430.878407:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788845430.878414:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189576960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845430.878449:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189576960:12345-0@lo:400:kworker.0 Request processed in 35us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845430.878455:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788845430.878482:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189576960:0@lo:400:kworker.0 00000040:00080000:1.0:1788845431.196098:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788845431.389029:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7fa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189577344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845431.389193:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845431.389265:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189577344 00000100:00100000:3.0:1788845431.389691:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189577344 00000100:00100000:3.0:1788845431.391315:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788845431.391329:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189577344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845431.391468:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845431.391546:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189577344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 220us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845431.391553:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788845431.391641:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7fa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189577344:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788845431.643988:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845432.667606:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845433.691810:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845434.715772:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845435.611915:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845435.611967:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845435.612069:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180109696 00000100:00100000:3.0:1788845435.612079:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180109696 00000100:00100000:3.0:1788845435.612157:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:3.0:1788845435.612168:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+5:2372:x1875740180109696:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845435.612261:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+5:2372:x1875740180109696:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 95us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845435.612286:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00080000:2.0:1788845435.612514:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845435.612844:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180109568 00000100:00100000:1.0:1788845435.612849:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180109568 00000100:00100000:1.0:1788845435.612896:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 269 00000100:00100000:1.0:1788845435.612904:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:2372:x1875740180109568:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845435.612949:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:2372:x1875740180109568:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 47us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845435.612956:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 269 00000100:00100000:2.0:1788845435.625188:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845435.625251:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845435.625409:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180109824 00000100:00100000:1.0:1788845435.625418:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180109824 00000100:00100000:1.0:1788845435.625491:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:1.0:1788845435.625509:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+5:2371:x1875740180109824:12345-192.168.206.35@tcp:9:kworker.0 00000020:00000080:1.0:1788845435.625538:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9902 00000100:00080000:1.0:1788845435.625546:0:6659:0:(import.c:65:import_set_state_nolock()) ffff92aeae46a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788845435.625581:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1788845435.625815:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845435.626137:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+2:2371:x1875740180109824:12345-192.168.206.35@tcp:9:kworker.0 Request processed in 636us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845435.626146:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:0.0:1788845435.627167:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180109952 00000100:00100000:0.0:1788845435.627184:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180109952 00000100:00100000:0.0:1788845435.627240:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00100000:0.0:1788845435.627248:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180109952:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845435.627303:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180109952:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 56us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845435.627310:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00080000:2.0:1788845435.627947:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845435.627954:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788845435.739678:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845435.995769:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189577728:0@lo:400:kworker.0 00000100:00100000:0.0:1788845435.995845:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845435.995920:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189577472:0@lo:400:kworker.0 00000100:00100000:0.0:1788845435.995923:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845435.995933:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189577856:0@lo:400:kworker.0 00000100:00100000:3.0:1788845435.996004:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189577600:0@lo:400:kworker.0 00000100:00100000:2.0:1788845435.996127:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845435.996142:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189578240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845435.997161:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845435.997173:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845435.997283:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189577984:0@lo:400:kworker.0 00000100:00100000:1.0:1788845435.997317:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845435.997381:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189577728 00000100:00100000:1.0:1788845435.997389:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189577728 00000100:00100000:1.0:1788845435.997443:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189577984 00000100:00100000:1.0:1788845435.997447:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189577984 00000100:00100000:3.0:1788845435.999219:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845435.999305:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845435.999384:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189578240 00000100:00100000:2.0:1788845435.999391:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189578240 00000100:00100000:2.0:1788845435.999456:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788845435.999466:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189578240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845435.999505:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845435.999561:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189578240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845435.999568:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788845435.999642:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc895500 x1875740189578240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845435.999661:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189578240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845436.004233:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189577472 00000100:00100000:2.0:1788845436.004255:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189577472 00000100:00100000:0.0:1788845436.004550:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189577856 00000100:00100000:0.0:1788845436.004555:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189577856 00000100:00100000:0.0:1788845436.004600:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788845436.004610:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189577856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845436.004805:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788845436.004814:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3285:x1875740189577472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845436.004863:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3285:x1875740189577472:12345-0@lo:400:kworker.0 Request processed in 51us (7707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845436.004869:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788845436.004950:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189577856:12345-0@lo:400:kworker.0 Request processed in 342us (7779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845436.004956:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788845436.005374:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189578112:0@lo:400:kworker.0 00000100:00100000:3.0:1788845436.005425:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845436.005453:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189578112 00000100:00100000:3.0:1788845436.005469:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189578112 00000100:00100000:3.0:1788845436.005505:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788845436.005514:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189578112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845436.005547:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189578112:12345-0@lo:400:kworker.0 Request processed in 36us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845436.005554:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788845436.005591:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189578112:0@lo:400:kworker.0 00000100:00100000:3.0:1788845436.005655:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189577472:0@lo:400:kworker.0 00000100:00100000:1.0:1788845436.005951:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189577600 00000100:00100000:1.0:1788845436.005957:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189577600 00000100:00100000:2.0:1788845436.006043:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788845436.006053:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189577728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845436.006092:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189577728:12345-0@lo:400:kworker.0 Request processed in 41us (10247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845436.006099:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788845436.006112:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788845436.006117:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189577984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845436.006149:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189577984:12345-0@lo:400:kworker.0 Request processed in 31us (8831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845436.006154:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788845436.006165:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788845436.006171:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189577600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845436.006205:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189577600:12345-0@lo:400:kworker.0 Request processed in 34us (6994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845436.006211:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788845436.006261:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189577984:0@lo:400:kworker.0 00000100:00100000:2.0:1788845436.006287:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189577600:0@lo:400:kworker.0 00000100:00080000:2.0:1788845436.006339:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845436.006344:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788845436.006347:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788845436.006410:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeae50ad80 x1875740189577856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845436.006422:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189577856:0@lo:400:kworker.0 00000100:00100000:2.0:1788845436.006436:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189577728:0@lo:400:kworker.0 00000100:00100000:1.0:1788845436.509093:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845436.509119:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189578368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845436.509209:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845436.509349:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189578368 00000100:00100000:1.0:1788845436.509357:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189578368 00000100:00100000:1.0:1788845436.513120:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788845436.513151:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189578368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845436.513193:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845436.514706:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189578368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1562us (5488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845436.514721:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788845436.514901:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189578368:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788845436.581591:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00000020:00000080:0.0:1788845436.581606:0:7612:0:(genops.c:885:class_export_put()) final put ffff92aeae46c800/704fd1fa-8fb6-403c-867f-b875231088ec 00000020:00000080:1.0:1788845436.581693:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae46c800/704fd1fa-8fb6-403c-867f-b875231088ec for lustre-OST0001 00000020:00000080:1.0:1788845436.581750:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aeae46a800 for lustre-OST0001 00010000:00010000:2.0:1788845436.763728:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845437.787903:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845438.811601:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845439.835787:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845440.733461:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845440.733591:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845440.733634:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180110080 00000100:00100000:2.0:1788845440.733635:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845440.733645:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180110080 00000100:00100000:1.0:1788845440.733703:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 271 00000100:00100000:1.0:1788845440.733712:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180110080:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845440.733780:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180110080:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 68us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845440.733786:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 271 00000100:00100000:0.0:1788845440.733885:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180110336 00000100:00100000:0.0:1788845440.733890:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180110336 00000100:00100000:2.0:1788845440.733925:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180110208 00000100:00100000:2.0:1788845440.733930:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180110208 00000100:00100000:0.0:1788845440.733956:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:0.0:1788845440.733968:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180110336:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845440.733972:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:2.0:1788845440.733983:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180110208:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845440.734017:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180110336:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 53us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845440.734024:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:2.0:1788845440.734036:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180110208:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 53us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845440.734043:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00080000:1.0:1788845440.734156:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788845440.860698:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845441.115599:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189578624:0@lo:400:kworker.0 00000100:00100000:1.0:1788845441.115631:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189578496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845441.117093:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875740189578880:0@lo:400:kworker.0 00000100:00100000:2.0:1788845441.117157:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189578752:0@lo:400:kworker.0 00000100:00100000:1.0:1788845441.117197:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845441.117336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845441.117410:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189579136:0@lo:400:kworker.0 00000100:00100000:3.0:1788845441.117451:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845441.117467:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189578496 00000100:00100000:0.0:1788845441.117475:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189578496 00000100:00100000:3.0:1788845441.117486:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845441.117493:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189579008:0@lo:400:kworker.0 00000100:00100000:3.0:1788845441.117520:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845441.117539:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788845441.117552:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189579008 00000100:00100000:0.0:1788845441.117552:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189578496:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845441.117563:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189579008 00000100:00100000:3.0:1788845441.117605:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788845441.117612:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189579008:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788845441.117656:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845441.117671:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189579008:12345-0@lo:400:kworker.0 Request processed in 59us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845441.117679:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788845441.117716:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc896300 x1875740189579008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845441.117730:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189579008:0@lo:400:kworker.0 00000100:00100000:0.0:1788845441.117761:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189578496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 213us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845441.117769:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788845441.117929:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeb95bd500 x1875740189578496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845441.117945:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189578496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845441.117982:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189579136 00000100:00100000:1.0:1788845441.117986:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189579136 00000100:00100000:0.0:1788845441.118039:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788845441.118105:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845441.118109:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845441.118136:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189578880 00000100:00100000:1.0:1788845441.118140:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189578880 00000100:00100000:1.0:1788845441.118187:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788845441.118194:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875740189579136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845441.118234:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875740189579136:12345-0@lo:400:kworker.0 Request processed in 40us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845441.118240:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788845441.118253:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788845441.118260:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875740189578880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845441.118289:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875740189578880:12345-0@lo:400:kworker.0 Request processed in 30us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845441.118294:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788845441.118321:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189579136:0@lo:400:kworker.0 00000100:00080000:0.0:1788845441.118458:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845441.118479:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875740189578880:0@lo:400:kworker.0 00000100:00100000:2.0:1788845441.118775:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845441.118808:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189579264:0@lo:400:kworker.0 00000100:00100000:1.0:1788845441.118829:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189578752 00000100:00100000:1.0:1788845441.118835:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189578752 00000100:00100000:2.0:1788845441.118846:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845441.118868:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788845441.118875:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189578752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845441.118882:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189578624 00000100:00100000:2.0:1788845441.118888:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189578624 00000100:00100000:1.0:1788845441.118921:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189578752:12345-0@lo:400:kworker.0 Request processed in 45us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845441.118924:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788845441.118934:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788845441.118936:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189578624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845441.119146:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189579264 00000100:00100000:3.0:1788845441.119150:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189579264 00000100:00100000:3.0:1788845441.119181:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788845441.119187:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189579264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845441.120135:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189578624:0@lo:400:kworker.0 00000100:00100000:2.0:1788845441.120503:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189578624:12345-0@lo:400:kworker.0 Request processed in 1568us (3164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845441.120513:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:2.0:1788845441.120955:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845441.120992:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189578752:0@lo:400:kworker.0 00000100:00100000:2.0:1788845441.121020:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189579264:0@lo:400:kworker.0 00000100:00100000:3.0:1788845441.123186:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189579264:12345-0@lo:400:kworker.0 Request processed in 3989us (4331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845441.123199:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:1.0:1788845441.438036:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788845441.628937:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189579392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845441.629037:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845441.629144:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189579392 00000100:00100000:3.0:1788845441.629151:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189579392 00000100:00100000:3.0:1788845441.629760:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788845441.629772:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189579392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845441.629805:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845441.629858:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189579392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845441.629864:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788845441.629882:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189579392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788845441.883914:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845442.535328:0:11809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:30:41 (1788845441) 00010000:00010000:3.0:1788845442.907815:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845443.639136:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845443.639226:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180110464 00000100:00100000:1.0:1788845443.639236:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180110464 00000100:00100000:1.0:1788845443.639316:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:1.0:1788845443.639328:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+5:10238:x1875740180110464:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845443.639346:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845443.639400:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df99cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775231c expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.639464:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df99d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.639477:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df99d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.639490:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df99d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845443.639527:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845443.639531:0:7234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845443.639573:0:7234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df99d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.639597:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df99cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775231c expref: 7 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.639617:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df99d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775231c expref: 6 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.639649:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e900) 00010000:00010000:1.0:1788845443.639652:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845443.639655:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09400, rc 0) 00000100:00100000:1.0:1788845443.639722:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+6:10238:x1875740180110464:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 397us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845443.639728:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00080000:2.0:1788845443.639801:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845443.648115:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845443.648281:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180110592 00000100:00100000:0.0:1788845443.648291:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180110592 00000100:00100000:0.0:1788845443.648353:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:0.0:1788845443.648394:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:10239:x1875740180110592:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845443.648422:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845443.648448:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df99db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752323 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648512:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df99e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648526:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df99e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648537:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df99e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648569:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df99e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648584:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df99e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648591:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df99e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648815:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6df99f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648825:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6df99f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648832:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6df99f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845443.648860:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788845443.648870:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845443.648900:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6df99f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648924:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df99e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648931:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df99e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648937:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df99e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648943:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1f400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845443.648948:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df99e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648959:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df99e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648971:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e900) 00010000:00010000:0.0:1788845443.648974:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845443.648978:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df99e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.648984:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df99e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.649008:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df99e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.649014:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df99e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.649030:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df99e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.649036:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1ee00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845443.649039:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df99e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.649045:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df99e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.649053:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff92ae83de9f00) 00010000:00010000:0.0:1788845443.649055:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845443.649058:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df99e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.649064:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df99e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.649095:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df99db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752323 expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.649107:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6df99f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752323 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845443.649113:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ae83de9b00) 00010000:00010000:0.0:1788845443.649115:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845443.649118:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f000, rc 0) 00000100:00100000:0.0:1788845443.649193:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+7:10239:x1875740180110592:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 802us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845443.649210:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:3.0:1788845443.652467:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845443.652563:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180110848 00000100:00100000:1.0:1788845443.652573:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180110848 00000100:00100000:1.0:1788845443.652693:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:1.0:1788845443.652703:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:10239:x1875740180110848:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845443.652722:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845443.652740:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df99f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775232a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.652822:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df99fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.652839:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df99fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.652849:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df99fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.653106:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9a05 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.653115:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9a05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.653142:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9a05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.655584:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df9a0c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.655606:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df9a0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.655616:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df9a0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845443.655626:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788845443.655946:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df99fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.655955:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df99fe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.655962:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df99fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.655968:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845443.655973:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df99fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.655981:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df99fe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656004:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ae83de9b00) 00010000:00010000:1.0:1788845443.656008:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845443.656022:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df99fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656028:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df99fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656044:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9a05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656051:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9a05 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656056:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9a05 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656062:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845443.656065:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9a05 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656071:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9a05 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656080:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff92ae93b8e600) 00010000:00010000:1.0:1788845443.656082:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845443.656085:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9a05 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656091:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9a05 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656924:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df99f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775232a expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656957:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df9a0c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775232a expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845443.656965:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:1.0:1788845443.656968:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845443.656971:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08800, rc 0) 00000100:00100000:1.0:1788845443.657139:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+9:10239:x1875740180110848:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 4435us (4682us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788845443.657148:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:0.0:1788845443.674252:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845443.674455:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180110976 00000100:00100000:2.0:1788845443.674465:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180110976 00000100:00100000:2.0:1788845443.674546:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:2.0:1788845443.674556:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+9:10239:x1875740180110976:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788845443.674913:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+9:10239:x1875740180110976:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 Request processed in 357us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845443.674922:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 35 00010000:00010000:1.0:1788845443.931537:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788845444.509268:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788845444.957311:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845445.096228:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845445.096337:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180111104 00000100:00100000:1.0:1788845445.096347:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180111104 00000100:00100000:1.0:1788845445.096440:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:1.0:1788845445.096451:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+9:10281:x1875740180111104:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1788845445.096469:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845445.096493:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9a1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752331 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096552:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096567:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096577:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096604:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096611:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096617:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096822:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096829:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096835:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096841:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845445.096844:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096861:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096873:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e900) 00010000:00010000:1.0:1788845445.096876:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845445.096880:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096886:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096906:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096913:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096920:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096926:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845445.096929:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096936:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096944:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff92ae93b8e600) 00010000:00010000:1.0:1788845445.096946:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845445.096949:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096955:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.096996:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9a1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752331 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.097008:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e900) 00010000:00010000:1.0:1788845445.097011:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845445.097021:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9a1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752331 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.097032:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09200, rc 0) 00000100:00100000:1.0:1788845445.097101:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+9:10281:x1875740180111104:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 651us (886us total) trans 0 rc 301/301 00000100:00100000:1.0:1788845445.097107:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00080000:2.0:1788845445.097189:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845445.107630:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845445.107718:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180111360 00000100:00100000:3.0:1788845445.107727:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180111360 00000100:00100000:3.0:1788845445.107784:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:3.0:1788845445.107794:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+9:10281:x1875740180111360:12345-192.168.206.35@tcp:36:lfs.0 00010000:00010000:3.0:1788845445.107846:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845445.107870:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df99d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775231c expref: 9 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.107888:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e900) 00010000:00010000:3.0:1788845445.107899:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845445.108139:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9a2f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.108152:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9a2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.108163:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9a2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.108174:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9a36 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.108181:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9a36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.108188:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9a36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845445.109130:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788845445.109149:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9a2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.109157:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9a2f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.109163:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9a2f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.109169:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ba00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845445.109173:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9a2f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.109180:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9a2f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.109191:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae90a6f600) 00010000:00010000:3.0:1788845445.109194:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845445.109197:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9a2f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.109203:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9a2f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845445.109218:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ec45c74 reply state 00000000d5f510d4 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9a36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845445.109226:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845445.109335:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+10:10281:x1875740180111360:12345-192.168.206.35@tcp:36:lfs.0 Request processed in 1541us (1716us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788845445.109343:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 37 00010000:00010000:3.0:1788845445.111744:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9a36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.111774:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9a36 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.111782:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9a36 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.111792:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845445.111797:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9a36 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.111806:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9a36 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.111820:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff92ae90a6fe00) 00010000:00010000:3.0:1788845445.111823:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845445.111827:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9a36 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.111832:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9a36 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845445.171917:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.172159:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180111488 00000100:00100000:0.0:1788845445.172170:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180111488 00000100:00100000:0.0:1788845445.172234:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:0.0:1788845445.172244:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+9:10289:x1875740180111488:12345-192.168.206.35@tcp:101:lctl.0 00010000:00010000:0.0:1788845445.172267:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845445.172288:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9a3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752338 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.172353:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df9a44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.172395:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df9a44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.172406:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df9a44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845445.172443:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788845445.172447:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845445.172483:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df9a44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.172506:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9a3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752338 expref: 11 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.172521:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df9a44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752338 expref: 10 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.172544:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:0.0:1788845445.172547:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845445.172550:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1ee00, rc 0) 00000100:00100000:0.0:1788845445.172599:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+10:10289:x1875740180111488:12345-192.168.206.35@tcp:101:lctl.0 Request processed in 356us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845445.172605:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:2.0:1788845445.226926:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845445.227034:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180111616 00000100:00100000:1.0:1788845445.227044:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180111616 00000100:00100000:1.0:1788845445.227104:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:1.0:1788845445.227113:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+10:10295:x1875740180111616:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1788845445.227132:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845445.227152:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9a4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775233f expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.227217:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.227231:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.227242:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.227257:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.227264:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.227271:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228448:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228475:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228485:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845445.228518:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788845445.228522:0:7234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845445.228562:0:7234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228575:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228582:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228589:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228595:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845445.228600:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228607:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228618:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:2.0:1788845445.228621:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845445.228625:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228641:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9a52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228671:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228678:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228684:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228688:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845445.228691:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228697:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228707:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff92ae93b8e600) 00010000:00010000:2.0:1788845445.228710:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845445.228712:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228729:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9a59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228766:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9a4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775233f expref: 12 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228780:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775233f expref: 11 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.228794:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845445.228797:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788845445.228804:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1a00, rc 0) 00000100:00100000:2.0:1788845445.228869:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+11:10295:x1875740180111616:12345-192.168.206.35@tcp:101:bash.0 Request processed in 1757us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845445.229016:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:3.0:1788845445.231471:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845445.231512:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180111872 00000100:00100000:2.0:1788845445.231522:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180111872 00000100:00100000:2.0:1788845445.231592:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:2.0:1788845445.231601:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+11:10295:x1875740180111872:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1788845445.231619:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845445.231636:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9a67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752346 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.231751:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9a6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.231764:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9a6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.231775:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9a6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.231789:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9a75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.231796:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.231822:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788845445.232794:0:5818:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788845445.232973:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9a7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.232997:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.233007:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.233039:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9a6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.233046:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9a6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.233053:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9a6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.233059:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0a00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845445.233063:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9a6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.233070:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9a6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.233080:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845445.233083:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845445.233094:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9a6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.233101:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9a6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845445.233116:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d690e9d1 reply state 00000000f84230c5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845445.233125:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788845445.233156:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9a67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752346 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.233265:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752346 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.233273:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae931ba200) 00010000:00010000:2.0:1788845445.233276:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845445.233278:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1000, rc 0) 00000100:00100000:2.0:1788845445.233350:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+14:10295:x1875740180111872:12345-192.168.206.35@tcp:101:bash.0 Request processed in 1750us (1890us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788845445.233358:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 40 00010000:00010000:2.0:1788845445.235499:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.235526:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9a75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.235534:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.235560:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845445.235566:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.235572:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9a75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.235587:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae931ba100) 00010000:00010000:2.0:1788845445.235590:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845445.235594:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9a75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.235600:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9a75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845445.238057:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.238436:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180112000 00000100:00100000:0.0:1788845445.238447:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180112000 00000100:00100000:0.0:1788845445.238493:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:0.0:1788845445.238502:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875740180112000:12345-192.168.206.35@tcp:8:bash.0 00010000:00080000:0.0:1788845445.238638:0:6656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:0.0:1788845445.238725:0:6656:0:(genops.c:1385:class_connect()) connect: client 704fd1fa-8fb6-403c-867f-b875231088ec, cookie 0xd8041b54d6df9a8a 00002000:00100000:0.0:1788845445.238736:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 704fd1fa-8fb6-403c-867f-b875231088ec/ffff92aebca04800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788845445.238766:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788845445.239027:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788845445.239058:0:6656:0:(import.c:65:import_set_state_nolock()) ffff92aebca03800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845445.239397:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2371:x1875740180112000:12345-192.168.206.35@tcp:8:bash.0 Request processed in 894us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845445.239406:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:3.0:1788845445.242495:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.242859:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180112128 00000100:00100000:0.0:1788845445.242870:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180112128 00000100:00100000:0.0:1788845445.242969:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:0.0:1788845445.242979:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:0:x1875740180112128:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1788845445.243005:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845445.243050:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948a111f/0xd8041b54d6df9a91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775234d expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788845445.243081:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788845445.243098:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=254s v=(0 0) 00010000:00010000:0.0:1788845445.243103:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845445.243112:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948a111f/0xd8041b54d6df9a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775234d expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.243132:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000948a111f/0xd8041b54d6df9a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775234d expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.243144:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f400, rc 0) 00000100:00100000:0.0:1788845445.243215:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:0:x1875740180112128:12345-192.168.206.35@tcp:101:bash.0 Request processed in 238us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845445.243221:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00080000:2.0:1788845445.244566:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845445.245472:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.246641:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180112256 00000100:00100000:0.0:1788845445.246764:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180112256 00000100:00100000:0.0:1788845445.246833:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:0.0:1788845445.246841:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:10295:x1875740180112256:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1788845445.246858:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845445.246874:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752354 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.246908:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000948a111f/0xd8041b54d6df9a91 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775234d expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.246937:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845445.246942:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845445.246947:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.246995:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000948a111f/0xd8041b54d6df9a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775234d expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.247010:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000948a111f/0xd8041b54d6df9a91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775234d expref: 8 pid: 6659 timeout: 354 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845445.247024:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1875740189579520:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845445.247118:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc268240 going to sleep for 11 seconds 00000100:00100000:0.0:1788845445.249248:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1875740189579520:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845445.249284:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.249305:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1fc00, rc 0) 00000100:00100000:0.0:1788845445.249402:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+8:10295:x1875740180112256:12345-192.168.206.35@tcp:101:bash.0 Request processed in 2523us (3898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845445.249410:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:2.0:1788845445.250048:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845445.250412:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180112384 00000100:00100000:1.0:1788845445.250421:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180112384 00010000:00010000:1.0:1788845445.250465:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000948a111f/0xd8041b54d6df9a91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775234d expref: 8 pid: 6659 timeout: 354 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845445.250501:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:1.0:1788845445.250515:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7553b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+8:2372:x1875740180112384:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845445.250526:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845445.250549:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000948a111f/0xd8041b54d6df9a91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775234d expref: 8 pid: 6659 timeout: 354 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.250562:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000948a111f/0xd8041b54d6df9a91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775234d expref: 8 pid: 6659 timeout: 354 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.250583:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948a111f/0xd8041b54d6df9a91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775234d expref: 8 pid: 6659 timeout: 354 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.250601:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845445.250605:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845445.250613:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.250623:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.250680:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845445.250694:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7fa8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5802:1875740189579648:192.168.206.35@tcp:105: 00000100:00100000:1.0:1788845445.250762:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae90919240 going to sleep for 11 seconds 00000100:00100000:1.0:1788845445.253043:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7fa8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5802:1875740189579648:192.168.206.35@tcp:105: 00010000:00010000:1.0:1788845445.253072:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845445.253128:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7553b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180112384:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 2614us (3082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845445.253139:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:3.0:1788845445.255812:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845445.255940:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180112640 00000100:00100000:2.0:1788845445.256015:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180112640 00000100:00100000:2.0:1788845445.256077:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:2.0:1788845445.256087:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+13:10295:x1875740180112640:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:2.0:1788845445.257231:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+14:10295:x1875740180112640:12345-192.168.206.35@tcp:35:bash.0 Request processed in 1138us (1425us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788845445.257242:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:2.0:1788845445.308116:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.308229:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180112896 00000100:00100000:0.0:1788845445.308238:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180112896 00000100:00100000:0.0:1788845445.308414:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:0.0:1788845445.308440:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+14:10305:x1875740180112896:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845445.308463:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845445.308483:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9a9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775235b expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845445.308576:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788845445.308705:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9a9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775235b expref: 16 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.308719:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:0.0:1788845445.308723:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845445.308727:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9a9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775235b expref: 16 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.308743:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1fe00, rc 0) 00000100:00100000:0.0:1788845445.308806:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+15:10305:x1875740180112896:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 369us (703us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788845445.308813:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:0.0:1788845445.314805:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845445.315266:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180113152 00000100:00100000:1.0:1788845445.315276:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180113152 00000100:00100000:1.0:1788845445.315337:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:1.0:1788845445.315347:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+15:10305:x1875740180113152:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:1.0:1788845445.315628:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+16:10305:x1875740180113152:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 282us (834us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788845445.315636:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:1.0:1788845445.361237:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845445.363017:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180113280 00000100:00100000:2.0:1788845445.363038:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180113280 00000100:00100000:2.0:1788845445.363203:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:2.0:1788845445.363215:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+16:10311:x1875740180113280:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845445.363240:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845445.363260:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752362 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.363324:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0800/0xd8041b54d6df9ab4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.363336:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0800/0xd8041b54d6df9ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.363347:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0800/0xd8041b54d6df9ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845445.363401:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788845445.363405:0:7234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845445.363427:0:7234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0800/0xd8041b54d6df9ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.363453:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752362 expref: 18 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.363473:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0800/0xd8041b54d6df9ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752362 expref: 17 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.363481:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845445.363483:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845445.363486:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0800, rc 0) 00000100:00100000:2.0:1788845445.363563:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+17:10311:x1875740180113280:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 351us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845445.363576:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:3.0:1788845445.368867:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845445.369742:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180113536 00000100:00100000:2.0:1788845445.369752:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180113536 00000100:00100000:2.0:1788845445.369811:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:2.0:1788845445.369820:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+17:10311:x1875740180113536:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845445.369842:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845445.369861:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9abb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752369 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.369952:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.369963:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.369974:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845445.369996:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788845445.370122:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9abb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752369 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.370138:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752369 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.370146:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae931ba200) 00010000:00010000:2.0:1788845445.370149:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845445.370152:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1e00, rc 0) 00000100:00100000:2.0:1788845445.370224:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+19:10311:x1875740180113536:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 405us (1371us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788845445.370231:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:1.0:1788845445.374160:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845445.374207:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.374297:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180113792 00000100:00100000:0.0:1788845445.374308:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180113792 00000100:00100000:0.0:1788845445.374401:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:0.0:1788845445.374411:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+19:10311:x1875740180113792:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845445.374435:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845445.374455:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9ad0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752370 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.374588:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9ad7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.374602:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.374613:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845445.374625:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788845445.374752:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9ad0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752370 expref: 22 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.374771:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752370 expref: 21 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.374779:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae931ba200) 00010000:00010000:0.0:1788845445.374782:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788845445.374785:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f400, rc 0) 00000100:00100000:0.0:1788845445.374846:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+21:10311:x1875740180113792:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 437us (699us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788845445.374853:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:2.0:1788845445.374993:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180113920 00000100:00100000:2.0:1788845445.374998:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180113920 00000100:00100000:2.0:1788845445.375044:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:2.0:1788845445.375052:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+21:2374:x1875740180113920:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845445.375062:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845445.375076:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752369 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.375088:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae931ba200) 00010000:00010000:2.0:1788845445.375090:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845445.375114:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+20:2374:x1875740180113920:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 63us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845445.375120:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:1.0:1788845445.382173:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845445.382234:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180114048 00000100:00100000:3.0:1788845445.382245:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180114048 00000100:00100000:3.0:1788845445.385699:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:3.0:1788845445.385722:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180114048:12345-192.168.206.35@tcp:1:lfs.0 00010000:00010000:3.0:1788845445.385768:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.385790:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.385800:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845445.385805:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845445.385809:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.385852:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.385867:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845445.385884:0:6658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae50ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1875740189579776:192.168.206.35@tcp:104: 00000100:00100000:3.0:1788845445.385996:0:6658:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788845445.389086:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845445.389123:0:6658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae50ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1875740189579776:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845445.389155:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845445.389734:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180114176 00000100:00100000:0.0:1788845445.389744:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180114176 00002000:00100000:0.0:1788845445.389794:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff92aeae50bb80 x1875740180114176/t0(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:551/0 lens 504/0 e 0 to 0 dl 1788845456 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788845445.389814:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeae50bb80 with x1875740180114176 ext(0->12) 00010000:00010000:0.0:1788845445.389839:0:6662:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 8 pid: 6656 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.389853:0:6662:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 8 pid: 6656 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788845445.389867:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92aeae50bb80 00000100:00100000:0.0:1788845445.389901:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:0.0:1788845445.389910:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180114176:12345-192.168.206.35@tcp:4:lfs.0 00000001:00100000:1.0:1788845445.441620:0:6682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00000001:00080000:0.0:1788845445.478395:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788845445.478573:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180114176:12345-192.168.206.35@tcp:4:lfs.0 Request processed in 88657us (89496us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788845445.478589:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00002000:00100000:2.0:1788845445.478603:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff92aeae50bb80 x1875740180114176/t4294967299(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:551/0 lens 504/448 e 0 to 0 dl 1788845456 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788845445.478632:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeae50bb80 with x1875740180114176 ext(0->12) 00010000:00010000:2.0:1788845445.478714:0:6662:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.478735:0:6662:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845445.478743:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92aeae50bb80 00000100:00100000:1.0:1788845445.481077:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845445.481223:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180114304 00000100:00100000:3.0:1788845445.481234:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180114304 00010000:00010000:3.0:1788845445.481274:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845445.481332:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:3.0:1788845445.481339:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:2375:x1875740180114304:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845445.481352:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788845445.481404:0:5804:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788845445.481408:0:5804:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788845444 00002000:00010000:3.0:1788845445.481410:0:5804:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788845444 00002000:00010000:3.0:1788845445.481412:0:5804:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788845444 00002000:00010000:3.0:1788845445.481414:0:5804:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788845445.481420:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.481432:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.481463:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093a102d8/0xd8041b54d6df9a98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752354 expref: 7 pid: 6656 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.481479:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845445.481483:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845445.481488:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.481502:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.481548:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845445.481607:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180114304:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 267us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845445.481615:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 36 00010000:00010000:1.0:1788845445.481624:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.481640:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.481669:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.481678:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.481686:0:6658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.481692:0:6658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845445.481696:0:6658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.481703:0:6658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.481715:0:6658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.481722:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9ae5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845445.482401:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180114048:12345-192.168.206.35@tcp:1:lfs.0 Request processed in 96651us (100203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845445.482409:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:1.0:1788845445.485238:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845445.485533:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180114560 00000100:00100000:3.0:1788845445.485543:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180114560 00000100:00100000:3.0:1788845445.485602:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:3.0:1788845445.485613:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+20:10311:x1875740180114560:12345-192.168.206.35@tcp:35:lfs.0 00000004:00010000:3.0:1788845445.485936:0:5820:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752370 expref: 20 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845445.487549:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788845445.488260:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788845445.489549:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788845445.489639:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.489854:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9a7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752346 expref: 24 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.489866:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.489906:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752346 expref: 24 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.489925:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9a7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752346 expref: 24 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845445.489940:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7552a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5820:1875740189579904:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845445.490110:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845445.493029:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845445.493142:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7552a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5820:1875740189579904:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845445.493167:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845445.493546:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180114688 00000100:00100000:0.0:1788845445.493554:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180114688 00010000:00010000:0.0:1788845445.493593:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9a7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752346 expref: 25 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845445.493677:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:0.0:1788845445.493688:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+25:2372:x1875740180114688:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845445.493703:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845445.493710:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9a7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752346 expref: 25 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.493722:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752346 expref: 25 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.493742:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9a7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752346 expref: 25 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.493794:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae931ba200) 00010000:00010000:0.0:1788845445.493799:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.493808:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.493816:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.493845:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845445.493899:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+24:2372:x1875740180114688:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 212us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845445.493908:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 37 00010000:00010000:3.0:1788845445.493963:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.493971:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845445.494115:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788845445.494403:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788845445.494535:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae508e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189580032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788845445.494582:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845445.494616:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845445.494899:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189580032 00000100:00100000:2.0:1788845445.494905:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189580032 00000100:00100000:2.0:1788845445.494961:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845445.494970:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1875740189580032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788845445.495057:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1875740189580032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845445.495063:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845445.495106:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae508e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189580032:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1788845445.495571:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788845445.495813:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788845445.495895:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189580160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788845445.495938:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845445.496176:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845445.496293:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189580160 00000100:00100000:1.0:1788845445.496300:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189580160 00000100:00100000:1.0:1788845445.496393:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845445.496403:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1875740189580160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788845445.496644:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5820:x1875740189580160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 242us (705us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788845445.496651:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845445.496719:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189580160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788845445.496782:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788845445.496833:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.496844:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.496851:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.496856:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0a00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845445.496861:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.496868:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.496882:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae931ba200) 00010000:00010000:3.0:1788845445.496885:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788845445.496889:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.496895:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9aec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788845445.497089:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788845445.497310:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788845445.497321:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 254716958173ns, next at 255716956161ns, rc = 0 00000001:00080000:3.0:1788845445.497328:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788845445.497406:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae931ba200) 00010000:00010000:3.0:1788845445.497410:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788845445.497417:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9ad7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752370 expref: 28 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845445.497695:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+27:10311:x1875740180114560:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 12083us (12472us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788845445.497713:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000020:00080000:2.0:1788845445.497718:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788845445.500442:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.500540:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180114816 00000100:00100000:0.0:1788845445.500551:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180114816 00000100:00100000:1.0:1788845445.500653:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:1.0:1788845445.500665:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+27:10311:x1875740180114816:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1788845445.500687:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845445.500709:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9af3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752377 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.500780:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752377 expref: 28 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.500795:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752377 expref: 28 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.501235:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:1.0:1788845445.501238:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845445.501260:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09000, rc 0) 00000100:00100000:1.0:1788845445.501321:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+28:10311:x1875740180114816:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 658us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845445.501329:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:3.0:1788845445.504132:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845445.506424:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180115072 00000100:00100000:2.0:1788845445.506444:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180115072 00000100:00100000:2.0:1788845445.506529:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:2.0:1788845445.506541:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+28:10311:x1875740180115072:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:2.0:1788845445.506827:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+29:10311:x1875740180115072:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 286us (2704us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788845445.506835:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:2.0:1788845445.582934:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.583061:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180115328 00000100:00100000:0.0:1788845445.583071:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180115328 00000100:00100000:0.0:1788845445.583175:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:0.0:1788845445.583186:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+29:10321:x1875740180115328:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845445.583212:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845445.583233:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9afa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775237e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845445.583331:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788845445.583966:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9afa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775237e expref: 31 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.583992:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:1.0:1788845445.583995:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845445.584000:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775237e expref: 31 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.584026:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1fe00, rc 0) 00000100:00100000:1.0:1788845445.584096:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+30:10321:x1875740180115328:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 913us (1175us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788845445.584103:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:3.0:1788845445.587208:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845445.587296:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180115456 00000100:00100000:1.0:1788845445.587306:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180115456 00000100:00100000:1.0:1788845445.587391:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:1.0:1788845445.587402:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+30:10321:x1875740180115456:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:1.0:1788845445.588113:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588131:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588141:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588177:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588185:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588192:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588293:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588301:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588307:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845445.588344:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588354:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588358:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588399:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588404:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845445.588407:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588417:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588426:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:1.0:1788845445.588428:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845445.588431:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588529:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588548:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588554:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588560:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588566:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845445.588569:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588574:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588582:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae93b8e500) 00010000:00010000:1.0:1788845445.588584:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845445.588587:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588603:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588619:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588626:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588633:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588637:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845445.588708:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588716:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588724:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:1.0:1788845445.588727:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845445.588729:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.588734:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845445.588865:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+30:10321:x1875740180115456:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 1461us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845445.588874:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:3.0:1788845445.591447:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.591590:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180115712 00000100:00100000:0.0:1788845445.591600:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180115712 00000100:00100000:0.0:1788845445.591667:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:0.0:1788845445.591685:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+30:10321:x1875740180115712:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845445.591934:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+31:10321:x1875740180115712:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 250us (499us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788845445.591942:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:3.0:1788845445.628654:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845445.628819:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180115968 00000100:00100000:1.0:1788845445.628829:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180115968 00000100:00100000:1.0:1788845445.628894:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:1.0:1788845445.628904:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+31:10324:x1875740180115968:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1788845445.628927:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845445.628945:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752385 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629026:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629040:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629052:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629066:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629073:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629080:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629214:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629223:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629253:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845445.629263:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788845445.629402:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629409:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629416:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629422:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845445.629427:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629434:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629445:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:1.0:1788845445.629448:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845445.629452:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629459:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9b24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629474:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629480:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629502:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629508:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845445.629511:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629518:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629525:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae93b8e500) 00010000:00010000:1.0:1788845445.629527:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845445.629530:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629536:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629575:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752385 expref: 34 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629588:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752385 expref: 33 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.629596:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:1.0:1788845445.629598:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845445.629601:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09200, rc 0) 00000100:00100000:1.0:1788845445.629660:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+33:10324:x1875740180115968:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 758us (1018us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788845445.629676:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:3.0:1788845445.634483:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845445.634698:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180116096 00000100:00100000:1.0:1788845445.634708:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180116096 00000100:00100000:1.0:1788845445.634763:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:1.0:1788845445.634774:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+33:10324:x1875740180116096:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:1.0:1788845445.634836:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.634851:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.634862:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.634901:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.634908:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.634915:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.634921:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845445.634926:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.634934:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.634944:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:1.0:1788845445.634970:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845445.634975:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.634990:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845445.635061:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+33:10324:x1875740180116096:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 289us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845445.635069:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:3.0:1788845445.641734:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.641991:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180116352 00000100:00100000:0.0:1788845445.642001:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180116352 00000100:00100000:0.0:1788845445.642057:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:0.0:1788845445.642067:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+33:10324:x1875740180116352:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845445.642306:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+34:10324:x1875740180116352:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 239us (584us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788845445.642315:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:3.0:1788845445.830469:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845445.830702:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180116608 00000100:00100000:1.0:1788845445.830712:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180116608 00000100:00100000:1.0:1788845445.830791:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:1.0:1788845445.830801:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+34:10355:x1875740180116608:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:1.0:1788845445.830823:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845445.830843:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775238c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.830947:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.830961:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.830974:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845445.830997:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788845445.831152:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775238c expref: 37 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.831193:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775238c expref: 36 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.831202:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:1.0:1788845445.831204:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845445.831207:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08e00, rc 0) 00000100:00100000:1.0:1788845445.831274:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+36:10355:x1875740180116608:12345-192.168.206.35@tcp:101:cat.0 Request processed in 474us (818us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788845445.831281:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:3.0:1788845445.835485:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845445.835532:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.835967:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180116736 00000100:00100000:0.0:1788845445.836005:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180116736 00000100:00100000:0.0:1788845445.836079:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:0.0:1788845445.836089:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+36:2372:x1875740180116736:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845445.836105:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845445.836127:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6df9b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775238c expref: 36 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845445.836148:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:0.0:1788845445.836153:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845445.836326:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+35:2372:x1875740180116736:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 237us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845445.836334:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:2.0:1788845445.836448:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180116992 00000100:00100000:2.0:1788845445.836461:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180116992 00000100:00100000:2.0:1788845445.836499:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:2.0:1788845445.836511:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+35:10355:x1875740180116992:12345-192.168.206.35@tcp:35:cat.0 00000100:00100000:2.0:1788845445.836735:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+36:10355:x1875740180116992:12345-192.168.206.35@tcp:35:cat.0 Request processed in 227us (1201us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788845445.836743:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:3.0:1788845445.852010:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845445.852298:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180117120 00000100:00100000:2.0:1788845445.852308:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180117120 00000100:00100000:2.0:1788845445.852398:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 273 00000100:00100000:2.0:1788845445.852408:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180117120:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845445.852579:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180117120:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 172us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845445.852587:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 273 00000100:00100000:2.0:1788845445.854422:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845445.854574:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180117248 00000100:00100000:0.0:1788845445.854602:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180117248 00000100:00100000:0.0:1788845445.854681:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00100000:0.0:1788845445.854692:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180117248:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845445.854776:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180117248:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845445.854783:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00080000:2.0:1788845445.856275:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845445.888744:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845445.888851:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180117504 00000100:00100000:1.0:1788845445.888862:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180117504 00000100:00100000:1.0:1788845445.888927:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:1.0:1788845445.888938:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+36:10361:x1875740180117504:12345-192.168.206.35@tcp:101:dd.0 00010000:00010000:1.0:1788845445.888960:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845445.888963:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788845445.889001:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0800/0xd8041b54d6df9ab4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752362 expref: 36 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.889022:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:1.0:1788845445.889027:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845445.889039:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752393 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.889228:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.889259:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9b32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752385 expref: 36 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.889267:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.889297:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752385 expref: 36 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.889311:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752385 expref: 36 pid: 7234 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845445.889325:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7faad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189580288:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845445.889584:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae90919900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845445.891530:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7faad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189580288:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845445.891557:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845445.894802:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845445.894872:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180117632 00000100:00100000:3.0:1788845445.894881:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180117632 00010000:00010000:3.0:1788845445.894933:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752385 expref: 37 pid: 7234 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845445.895212:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:3.0:1788845445.895223:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+37:2373:x1875740180117632:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845445.895247:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845445.895255:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752385 expref: 37 pid: 7234 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.895270:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752385 expref: 37 pid: 7234 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.895314:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9b32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752385 expref: 37 pid: 7234 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.895332:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:3.0:1788845445.895337:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.895346:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.895957:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.896146:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845445.896210:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+36:2373:x1875740180117632:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 987us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845445.896219:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00010000:00010000:3.0:1788845445.896271:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.896280:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845445.896299:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788845445.896512:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9b5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752393 expref: 37 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.896530:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752393 expref: 36 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.896538:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:3.0:1788845445.896541:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788845445.896553:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08c00, rc 0) 00000100:00100000:3.0:1788845445.896580:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+36:10361:x1875740180117504:12345-192.168.206.35@tcp:101:dd.0 Request processed in 7644us (7849us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788845445.896588:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:3.0:1788845445.901732:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845445.901941:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180117888 00000100:00100000:2.0:1788845445.901961:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180117888 00000100:00100000:2.0:1788845445.902035:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:2.0:1788845445.902044:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+36:10361:x1875740180117888:12345-192.168.206.35@tcp:36:dd.0 00010000:00010000:2.0:1788845445.902735:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6df9b71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.902753:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6df9b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845445.902765:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6df9b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845445.902827:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788845445.902853:0:7234:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000055ac540 reply state 000000000abfb53c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6df9b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845445.902862:0:7234:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845445.902952:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+39:10361:x1875740180117888:12345-192.168.206.35@tcp:36:dd.0 Request processed in 907us (1231us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788845445.902960:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 52 00000020:00080000:2.0:1788845445.902969:0:7234:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788845445.906255:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6df9b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.906273:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6df9b71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.906281:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6df9b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.906294:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845445.906299:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6df9b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.906307:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6df9b71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.906321:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:3.0:1788845445.906324:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845445.906328:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6df9b71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845445.906334:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6df9b71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845445.979927:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845446.103743:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845446.104396:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180118016 00000100:00100000:0.0:1788845446.104407:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180118016 00000100:00100000:0.0:1788845446.104480:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:0.0:1788845446.104492:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+38:10375:x1875740180118016:12345-192.168.206.35@tcp:101:stat.0 00010000:00010000:0.0:1788845446.104516:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845446.104538:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9b78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775239a expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.104643:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9b7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.104657:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9b7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.104669:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9b7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.104684:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9b86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.104691:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.104697:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.104813:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.104825:0:8176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752393 expref: 39 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.104833:0:8176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.104867:0:8176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752393 expref: 39 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.104882:0:8176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752393 expref: 39 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845446.104896:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95be680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189580416:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845446.105015:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8647af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845446.108971:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95be680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189580416:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845446.109019:0:8176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845446.109258:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845446.109339:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180118272 00000100:00100000:1.0:1788845446.109347:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180118272 00000100:00100000:1.0:1788845446.109427:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1788845446.109437:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+40:9248:x1875740180118272:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788845446.110120:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+41:9248:x1875740180118272:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 682us (861us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788845446.110129:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:0.0:1788845446.111632:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845446.111826:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180118400 00000100:00100000:1.0:1788845446.111835:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180118400 00010000:00010000:1.0:1788845446.111868:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752393 expref: 41 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845446.111910:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:1.0:1788845446.111920:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+41:2372:x1875740180118400:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845446.111932:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845446.111939:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752393 expref: 41 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.111952:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752393 expref: 41 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.111973:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9b63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752393 expref: 41 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.111999:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:1.0:1788845446.112005:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.112013:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.112021:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.112094:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845446.112143:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+40:2372:x1875740180118400:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 224us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845446.112164:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 39 00010000:00010000:0.0:1788845446.112821:0:8176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.112831:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845446.112878:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788845446.112882:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845446.112924:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.112952:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.112962:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9b7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113107:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9b7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113115:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9b7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113121:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1fc00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845446.113125:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9b7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113133:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9b7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113144:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:0.0:1788845446.113148:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845446.113151:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9b7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113163:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9b7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113179:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113186:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9b86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113201:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113207:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1fe00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845446.113211:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113218:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9b86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113226:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae83de9400) 00010000:00010000:0.0:1788845446.113229:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845446.113233:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9b86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113239:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9b86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113280:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9b78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775239a expref: 40 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113296:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775239a expref: 39 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.113304:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:0.0:1788845446.113306:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845446.113308:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f200, rc 0) 00000100:00100000:0.0:1788845446.113438:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+39:10375:x1875740180118016:12345-192.168.206.35@tcp:101:stat.0 Request processed in 8948us (9707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845446.113465:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:0.0:1788845446.159646:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845446.160127:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180118656 00000100:00100000:3.0:1788845446.160160:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180118656 00000100:00100000:3.0:1788845446.160282:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:3.0:1788845446.160293:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+39:10381:x1875740180118656:12345-192.168.206.35@tcp:36:truncate.0 00010000:00010000:3.0:1788845446.160393:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845446.160428:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9b8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775239a expref: 39 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.160450:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:3.0:1788845446.160454:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845446.160676:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9b94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.160689:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9b94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.160697:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9b94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845446.160750:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788845446.160775:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075b65e01 reply state 00000000bf1cea80 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9b94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845446.160785:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845446.160937:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+41:10381:x1875740180118656:12345-192.168.206.35@tcp:36:truncate.0 Request processed in 646us (1304us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788845446.160945:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 54 00000020:00080000:3.0:1788845446.160949:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788845446.165037:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9b94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.165058:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9b94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.165065:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9b94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.165071:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845446.165076:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9b94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.165083:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9b94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.165098:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:0.0:1788845446.165101:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845446.165105:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9b94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.165112:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9b94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845446.236866:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189580544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845446.236943:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845446.237156:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189580800:0@lo:400:kworker.0 00000100:00100000:0.0:1788845446.237190:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845446.237242:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189581312:0@lo:400:kworker.0 00000100:00100000:0.0:1788845446.237267:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845446.237316:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845446.237322:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189580928:0@lo:400:kworker.0 00000100:00100000:0.0:1788845446.237345:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845446.237433:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189581312 00000100:00100000:0.0:1788845446.237440:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189581312 00000100:00100000:0.0:1788845446.237521:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788845446.237548:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189581312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845446.237640:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189581312:12345-0@lo:400:kworker.0 Request processed in 111us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845446.237647:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788845446.237744:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189581312:0@lo:400:kworker.0 00000100:00100000:0.0:1788845446.237813:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189580800 00000100:00100000:0.0:1788845446.237826:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189580800 00000100:00100000:0.0:1788845446.237863:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189580928 00000100:00100000:0.0:1788845446.237866:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189580928 00000100:00100000:0.0:1788845446.237900:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788845446.237907:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189580800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845446.238007:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189580800:12345-0@lo:400:kworker.0 Request processed in 100us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845446.238014:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788845446.238026:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788845446.238033:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189580928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845446.238097:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189580928:12345-0@lo:400:kworker.0 Request processed in 64us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845446.238103:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788845446.238114:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189580672:0@lo:400:kworker.0 00000100:00100000:3.0:1788845446.238159:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845446.238177:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189580928:0@lo:400:kworker.0 00000100:00100000:0.0:1788845446.238239:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189580800:0@lo:400:kworker.0 00000100:00100000:3.0:1788845446.238266:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189581184:0@lo:400:kworker.0 00000100:00100000:3.0:1788845446.238298:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845446.238322:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189581184 00000100:00100000:3.0:1788845446.238323:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845446.238327:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189581184 00000100:00100000:3.0:1788845446.238332:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae90c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189581056:0@lo:400:kworker.0 00000100:00100000:0.0:1788845446.238405:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788845446.238413:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875740189581184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845446.238446:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875740189581184:12345-0@lo:400:kworker.0 Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845446.238452:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1788845446.238501:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845446.238506:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845446.238530:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189580672 00000100:00100000:0.0:1788845446.238534:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189580672 00000100:00100000:0.0:1788845446.238560:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788845446.238567:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189580672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845446.238661:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189580672:12345-0@lo:400:kworker.0 Request processed in 67us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845446.238667:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788845446.239422:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189580544 00000100:00100000:2.0:1788845446.239431:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189580544 00000100:00100000:3.0:1788845446.239469:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845446.239469:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788845446.239482:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875740189580544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845446.239500:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788845446.239550:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875740189580544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845446.239573:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788845446.239580:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189580672:0@lo:400:kworker.0 00000100:00100000:3.0:1788845446.239599:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189581184:0@lo:400:kworker.0 00000100:00100000:1.0:1788845446.239666:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189581056 00000100:00100000:1.0:1788845446.239670:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189581056 00000100:00100000:1.0:1788845446.239710:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788845446.239871:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189581056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845446.239964:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189581056:12345-0@lo:400:kworker.0 Request processed in 97us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845446.240141:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae90c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189581056:0@lo:400:kworker.0 00000100:00100000:1.0:1788845446.240189:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788845446.240300:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189580544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845446.277836:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845446.277932:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180118784 00000100:00100000:2.0:1788845446.277942:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180118784 00000100:00100000:2.0:1788845446.278013:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:2.0:1788845446.278024:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+40:10395:x1875740180118784:12345-192.168.206.35@tcp:101:stat.0 00010000:00010000:2.0:1788845446.278046:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845446.278066:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6df9b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523a1 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278131:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9ba2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278143:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278154:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278167:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9ba9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278174:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278180:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278290:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278298:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278323:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845446.278406:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788845446.278411:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845446.278435:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278459:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278467:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278474:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278481:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278488:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845446.278492:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278499:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9ba2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278509:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845446.278512:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845446.278516:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9ba2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278530:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9ba2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278545:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278551:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278556:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278560:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845446.278563:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278569:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278575:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae931baf00) 00010000:00010000:2.0:1788845446.278577:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845446.278580:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9ba9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278585:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9ba9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278630:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6df9b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523a1 expref: 42 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278644:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523a1 expref: 41 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.278657:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:2.0:1788845446.278660:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845446.278662:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1200, rc 0) 00000100:00100000:2.0:1788845446.278726:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+41:10395:x1875740180118784:12345-192.168.206.35@tcp:101:stat.0 Request processed in 704us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845446.278734:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:2.0:1788845446.349189:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845446.349492:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180119040 00000100:00100000:0.0:1788845446.349503:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180119040 00000100:00100000:0.0:1788845446.349572:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:0.0:1788845446.349582:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+41:10405:x1875740180119040:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845446.349601:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845446.349619:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9bb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523a8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845446.349717:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788845446.349862:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9bb7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523a8 expref: 43 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.349875:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:0.0:1788845446.349878:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845446.349883:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9bb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523a8 expref: 43 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.349897:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f400, rc 0) 00000100:00100000:0.0:1788845446.349972:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+42:10405:x1875740180119040:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 390us (794us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788845446.349988:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:3.0:1788845446.352812:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845446.352992:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180119296 00000100:00100000:2.0:1788845446.353002:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180119296 00000100:00100000:2.0:1788845446.353061:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:2.0:1788845446.353072:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+42:10405:x1875740180119296:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:2.0:1788845446.353343:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+43:10405:x1875740180119296:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 272us (542us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788845446.353359:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:3.0:1788845446.404231:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845446.405278:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180119552 00000100:00100000:0.0:1788845446.405291:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180119552 00000100:00100000:0.0:1788845446.405400:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:0.0:1788845446.405412:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+43:10411:x1875740180119552:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1788845446.405436:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845446.405455:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9bc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.405553:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.405566:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523a1 expref: 44 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.405573:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.405624:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523a1 expref: 44 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.405708:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523a1 expref: 44 pid: 8176 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845446.405722:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae295500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189581440:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845446.405875:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9eaa1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845446.414229:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845446.416055:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180119680 00000100:00100000:2.0:1788845446.416074:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180119680 00010000:00010000:2.0:1788845446.416131:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523a1 expref: 45 pid: 8176 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845446.416184:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:2.0:1788845446.416195:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+45:2373:x1875740180119680:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845446.416209:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845446.416216:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523a1 expref: 45 pid: 8176 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.416259:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523a1 expref: 45 pid: 8176 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.416283:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:2.0:1788845446.416290:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.416300:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.416308:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.416320:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6df9bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523a1 expref: 45 pid: 8176 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.416328:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845446.416344:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae295500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189581440:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845446.416399:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.416409:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.416415:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845446.416425:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+44:2373:x1875740180119680:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 232us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845446.416435:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 40 00000004:00200000:0.0:1788845446.416435:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788845446.416780:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9bc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523af expref: 45 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.416798:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523af expref: 44 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.416819:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:0.0:1788845446.416821:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788845446.416824:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1fe00, rc 0) 00000100:00100000:0.0:1788845446.416867:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+44:10411:x1875740180119552:12345-192.168.206.35@tcp:101:bash.0 Request processed in 11459us (12650us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788845446.416875:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:3.0:1788845446.420750:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845446.420855:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180119936 00000100:00100000:2.0:1788845446.420865:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180119936 00000100:00100000:2.0:1788845446.421711:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:2.0:1788845446.421726:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+44:10411:x1875740180119936:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:2.0:1788845446.422037:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9bda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.422053:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.422065:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845446.422138:0:8176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788845446.422163:0:8176:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9c5c8fd reply state 00000000f9b291e3 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845446.422172:0:8176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845446.422358:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+47:10411:x1875740180119936:12345-192.168.206.35@tcp:36:bash.0 Request processed in 635us (1619us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788845446.422389:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 58 00000020:00080000:2.0:1788845446.422394:0:8176:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788845446.427113:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.427134:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9bda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.427142:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9bda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.427148:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845446.427274:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9bda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.427285:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9bda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.427300:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:3.0:1788845446.427322:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845446.427327:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9bda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.427333:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9bda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845446.433118:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845446.433542:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180120064 00000100:00100000:2.0:1788845446.433553:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180120064 00000100:00100000:2.0:1788845446.433672:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:2.0:1788845446.433682:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+46:10411:x1875740180120064:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1788845446.433705:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845446.433725:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9be1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523b6 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.433807:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6df9be8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.433835:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523af expref: 47 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.433845:0:7234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6df9be8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.433880:0:7234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523af expref: 47 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.433918:0:7234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523af expref: 47 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845446.433931:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7553800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189581568:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845446.434037:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb96ab300 going to sleep for 11 seconds 00000100:00100000:3.0:1788845446.435955:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845446.436228:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7553800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189581568:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845446.436258:0:7234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6df9be8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845446.436503:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180120192 00000100:00100000:2.0:1788845446.436512:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180120192 00010000:00010000:2.0:1788845446.436547:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523af expref: 48 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845446.436589:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:2.0:1788845446.436598:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+48:2372:x1875740180120192:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845446.436611:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845446.436617:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523af expref: 48 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.436630:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523af expref: 48 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.436658:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9bcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523af expref: 48 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.436674:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:2.0:1788845446.436678:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6df9be8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.436705:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6df9be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.436712:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6df9be8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.436742:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845446.436789:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+47:2372:x1875740180120192:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 192us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845446.436797:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 41 00010000:00010000:0.0:1788845446.437432:0:7234:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6df9be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.437442:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6df9be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845446.437488:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788845446.437493:0:7234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845446.437513:0:7234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6df9be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.437543:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9be1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523b6 expref: 47 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.437559:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6df9be8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523b6 expref: 46 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.437581:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:0.0:1788845446.437584:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845446.437587:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0000, rc 0) 00000100:00100000:0.0:1788845446.437625:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+46:10411:x1875740180120064:12345-192.168.206.35@tcp:101:bash.0 Request processed in 3945us (4519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845446.437633:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:2.0:1788845446.446226:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845446.446325:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180120448 00000100:00100000:1.0:1788845446.446336:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180120448 00000100:00100000:1.0:1788845446.446419:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:1.0:1788845446.446431:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+46:10411:x1875740180120448:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:1.0:1788845446.450057:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+47:10411:x1875740180120448:12345-192.168.206.35@tcp:35:bash.0 Request processed in 3615us (3829us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788845446.450071:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:2.0:1788845446.508505:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845446.509063:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180120704 00000100:00100000:0.0:1788845446.509074:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180120704 00000100:00100000:0.0:1788845446.509161:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:0.0:1788845446.509172:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+47:10421:x1875740180120704:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845446.509195:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845446.509215:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9bef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845446.509307:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788845446.509613:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9bef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523bd expref: 49 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.509628:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:0.0:1788845446.509630:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845446.510048:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9bef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523bd expref: 49 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.510069:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f400, rc 0) 00000100:00100000:0.0:1788845446.510143:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+48:10421:x1875740180120704:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 973us (1651us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788845446.510170:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:3.0:1788845446.513053:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845446.514447:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180120832 00000100:00100000:2.0:1788845446.514460:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180120832 00000100:00100000:2.0:1788845446.514529:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:2.0:1788845446.514539:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+48:10421:x1875740180120832:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:2.0:1788845446.514614:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9bfd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514647:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9bfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514659:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9bfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514675:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514681:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514705:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514796:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9c0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514805:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514812:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845446.514856:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514869:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9bfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514875:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9bfd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514881:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9bfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514886:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845446.514891:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9bfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514897:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9bfd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514908:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845446.514916:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845446.514921:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9bfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514927:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9bfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514942:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514948:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514953:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514958:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0a00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845446.514960:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514966:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514985:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae931baf00) 00010000:00010000:2.0:1788845446.514988:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845446.514991:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.514997:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.515011:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.515024:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9c0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.515030:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.515034:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845446.515037:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.515042:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9c0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.515050:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:2.0:1788845446.515052:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845446.515055:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9c0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.515060:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9c0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845446.515205:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+48:10421:x1875740180120832:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 665us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845446.515214:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:2.0:1788845446.519472:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845446.519517:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180121088 00000100:00100000:0.0:1788845446.519528:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180121088 00000100:00100000:0.0:1788845446.520042:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:0.0:1788845446.520055:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+48:10421:x1875740180121088:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845446.520323:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+49:10421:x1875740180121088:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 270us (862us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788845446.520331:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:3.0:1788845446.552544:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845446.552735:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180121344 00000100:00100000:0.0:1788845446.552745:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180121344 00000100:00100000:0.0:1788845446.552863:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:0.0:1788845446.552874:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+49:10424:x1875740180121344:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845446.552898:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845446.552916:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9c12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523c4 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553000:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9c19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553014:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9c19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553026:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9c19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553042:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9c20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553071:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553079:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553210:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9c27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553219:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553226:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845446.553235:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788845446.553340:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9c19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553347:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9c19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553354:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9c19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553412:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1fc00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845446.553419:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9c19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553426:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9c19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553448:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:0.0:1788845446.553450:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845446.553455:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9c19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553461:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6df9c19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553476:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553482:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9c20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553488:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553493:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1fe00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845446.553496:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553502:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9c20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553511:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae83de9400) 00010000:00010000:0.0:1788845446.553513:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845446.553516:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9c20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553521:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6df9c20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553575:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6df9c12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523c4 expref: 52 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553588:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523c4 expref: 51 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.553595:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:0.0:1788845446.553597:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845446.553600:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f200, rc 0) 00000100:00100000:0.0:1788845446.553678:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+51:10424:x1875740180121344:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 806us (1145us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788845446.553686:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:3.0:1788845446.557057:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845446.557202:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180121472 00000100:00100000:0.0:1788845446.557211:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180121472 00000100:00100000:0.0:1788845446.557274:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:0.0:1788845446.557284:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+51:10424:x1875740180121472:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:0.0:1788845446.557404:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.557423:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.557435:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.557465:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.557482:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.557489:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.557495:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845446.557499:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.557507:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.557518:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:0.0:1788845446.557520:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845446.557524:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.557529:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845446.557605:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+51:10424:x1875740180121472:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 318us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845446.557613:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:3.0:1788845446.557790:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845446.557856:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180121600 00000100:00100000:1.0:1788845446.557861:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180121600 00000100:00100000:3.0:1788845446.559614:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845446.561402:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180121856 00000100:00100000:2.0:1788845446.561416:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180121856 00000100:00100000:2.0:1788845446.561483:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:2.0:1788845446.561494:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+52:10424:x1875740180121856:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:2.0:1788845446.561759:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+53:10424:x1875740180121856:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 266us (2163us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788845446.561768:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:1.0:1788845446.561888:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:1.0:1788845446.561900:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+52:2372:x1875740180121600:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845446.561912:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845446.561935:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6df9c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523c4 expref: 52 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.561963:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:1.0:1788845446.561967:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845446.562000:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+51:2372:x1875740180121600:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 103us (4211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845446.562007:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:2.0:1788845446.676797:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845446.677027:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180122112 00000100:00100000:0.0:1788845446.677037:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180122112 00000100:00100000:0.0:1788845446.677105:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:0.0:1788845446.677117:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+51:10442:x1875740180122112:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:0.0:1788845446.677140:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845446.677177:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523cb expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.677302:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9c43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.677317:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9c43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.677327:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9c43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845446.677338:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788845446.677680:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523cb expref: 54 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.677702:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9c43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523cb expref: 53 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.677711:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:0.0:1788845446.677714:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788845446.677717:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030200, rc 0) 00000100:00100000:0.0:1788845446.677786:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+53:10442:x1875740180122112:12345-192.168.206.35@tcp:101:cat.0 Request processed in 672us (1002us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788845446.677793:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:3.0:1788845446.711960:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845446.712053:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180122240 00000100:00100000:0.0:1788845446.712063:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180122240 00000100:00100000:0.0:1788845446.712171:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:0.0:1788845446.712194:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+53:10443:x1875740180122240:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845446.712246:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845446.712267:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523d2 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.712343:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9c58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.712356:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.712396:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845446.712442:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788845446.712446:0:7234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845446.712464:0:7234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.712490:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9c51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523d2 expref: 55 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.712509:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523d2 expref: 54 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.712529:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:0.0:1788845446.712531:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845446.712534:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845446.712607:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+54:10443:x1875740180122240:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 427us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845446.712622:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:3.0:1788845446.718932:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845446.719678:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180122624 00000100:00100000:2.0:1788845446.719698:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180122624 00000100:00100000:2.0:1788845446.719758:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:2.0:1788845446.719767:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+54:10443:x1875740180122624:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:2.0:1788845446.720084:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+55:10443:x1875740180122624:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 317us (1164us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788845446.720092:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:2.0:1788845446.723342:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845446.723447:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180122752 00000100:00100000:1.0:1788845446.723456:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180122752 00000100:00100000:1.0:1788845446.723519:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:1.0:1788845446.723529:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+55:10443:x1875740180122752:12345-192.168.206.35@tcp:103:lfs.0 00010000:00010000:1.0:1788845446.723544:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788845446.723576:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6df9be8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523b6 expref: 55 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.723599:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9c43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523cb expref: 54 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.723612:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9af3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752377 expref: 53 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.723621:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:1.0:1788845446.723630:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845446.723694:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+52:10443:x1875740180122752:12345-192.168.206.35@tcp:103:lfs.0 Request processed in 157us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845446.723700:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:3.0:1788845446.726811:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845446.726943:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180122880 00000100:00100000:1.0:1788845446.727152:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180122880 00000100:00100000:1.0:1788845446.727261:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00100000:1.0:1788845446.727272:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+52:10443:x1875740180122880:12345-192.168.206.35@tcp:58:lfs.0 00010000:00010000:1.0:1788845446.727836:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9c5f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.727854:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9c5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845446.727866:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9c5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788845446.728253:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788845446.728718:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788845446.728876:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788845446.729052:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+52:10443:x1875740180122880:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 1778us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845446.729063:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00100000:3.0:1788845446.745990:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845446.746127:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180123008 00000100:00100000:2.0:1788845446.746137:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180123008 00000100:00100000:2.0:1788845446.746204:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:2.0:1788845446.746214:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+52:10445:x1875740180123008:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845446.746396:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845446.746417:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9c66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523d9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746482:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9c6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746495:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9c6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746507:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9c6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746541:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746549:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746720:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746883:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746893:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746900:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845446.746937:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788845446.746941:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845446.746961:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746982:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746990:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9c6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.746996:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9c6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747012:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747019:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845446.747023:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747031:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9c6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747042:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845446.747046:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845446.747049:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9c6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747056:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9c6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747071:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747078:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747083:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747088:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845446.747091:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747108:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747116:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae931baf00) 00010000:00010000:2.0:1788845446.747118:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845446.747121:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747127:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747158:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9c66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523d9 expref: 54 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747171:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523d9 expref: 53 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845446.747191:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8e500) 00010000:00010000:2.0:1788845446.747193:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845446.747195:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0a00, rc 0) 00000100:00100000:2.0:1788845446.748510:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+53:10445:x1875740180123008:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 2287us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845446.748523:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:0.0:1788845446.749016:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189581696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845446.749076:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845446.749815:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189581696 00000100:00100000:2.0:1788845446.749825:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189581696 00000100:00100000:2.0:1788845446.749871:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788845446.749881:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189581696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845446.749916:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845446.749993:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189581696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845446.750009:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788845446.750536:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189581696:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788845446.799139:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:3.0:1788845446.799312:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:3.0:1788845446.799337:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ae8318f780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788845446.799342:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ae91615800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ae8318fb40 00000020:00080000:3.0:1788845446.799345:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ae91615700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92aeb7570c00 00000020:00080000:0.0:1788845446.799391:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:3.0:1788845446.799480:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788845446.799532:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788845446.799911:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189581824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788845446.799988:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845446.800125:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189581824 00000100:00100000:0.0:1788845446.800132:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189581824 00000100:00100000:0.0:1788845446.800403:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788845446.800414:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1875740189581824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788845446.800439:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788845446.800473:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f9d84, atime: 0x6a9f9d84, ctime: 0x6a9f9d84, blocks: 0xb 00010000:00010000:0.0:1788845446.800481:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6df9c82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.800497:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=256s v=(0 0) 00010000:00010000:0.0:1788845446.800502:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845446.800509:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6df9c82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.800523:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6df9c82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.800534:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6df9c82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.800542:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6df9c82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845446.800576:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788845446.801125:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3285:x1875740189581824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 710us (1133us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788845446.801133:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788845446.801243:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845446.801251:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6df9c82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.801261:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845446.801272:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6df9c82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.801282:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6df9c82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.801300:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6df9c82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.801308:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6df9c82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845446.801332:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845446.801334:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845446.801336:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788845446.801579:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92aeb7552680/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788845446.801586:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189581824:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788845447.004421:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788845447.370981:0:11958:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788845447.370994:0:11958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788845447.371053:0:11958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788845447.371060:0:11958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788845447.580246:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845447.580258:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788845447.580315:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788845447.580323:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788845447.580522:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7fa8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189581952:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788845447.580644:0:11641:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845447.587203:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7fa8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189581952:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788845447.589915:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.590032:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180123136 00000100:00100000:1.0:1788845447.590043:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180123136 00000100:00100000:1.0:1788845447.590117:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:1.0:1788845447.590129:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:704fd1fa-8fb6-403c-867f-b875231088ec+11:10457:x1875740180123136:12345-192.168.206.35@tcp:900:lhsmtool_posix.0 00000100:00080000:0.0:1788845447.590154:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845447.590215:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:704fd1fa-8fb6-403c-867f-b875231088ec+11:10457:x1875740180123136:12345-192.168.206.35@tcp:900:lhsmtool_posix.0 Request processed in 89us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845447.590222:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:3.0:1788845447.593588:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845447.593717:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180123264 00000100:00100000:0.0:1788845447.593727:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180123264 00000100:00100000:0.0:1788845447.593863:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:0.0:1788845447.593873:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+11:10457:x1875740180123264:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788845447.593929:0:7234:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788845447.594063:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+11:10457:x1875740180123264:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 191us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845447.594263:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:3.0:1788845447.600494:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.600554:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180123392 00000100:00100000:1.0:1788845447.600569:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180123392 00000100:00100000:1.0:1788845447.600631:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:1.0:1788845447.600646:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+11:10457:x1875740180123392:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788845447.600732:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9c89 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600748:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9c89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600764:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9c89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600778:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9c90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600785:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9c90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600796:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9c90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600849:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9c97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600858:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600865:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845447.600907:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788845447.600911:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845447.600925:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600935:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9c89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600942:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9c89 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600949:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9c89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600955:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845447.600959:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9c89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600976:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9c89 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.600989:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:1.0:1788845447.600999:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845447.601005:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9c89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601012:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9c89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601027:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9c90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601033:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9c90 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601039:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9c90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601044:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845447.601047:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9c90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601053:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9c90 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601061:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff92ae93b8e800) 00010000:00010000:1.0:1788845447.601063:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845447.601066:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9c90 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601071:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9c90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601085:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601270:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9c97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601275:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601280:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845447.601283:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601288:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9c97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601296:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8e500) 00010000:00010000:1.0:1788845447.601298:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845447.601301:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9c97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.601306:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9c97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845447.602022:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+11:10457:x1875740180123392:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 Request processed in 1373us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845447.602033:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:3.0:1788845447.609205:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845447.609317:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180123648 00000100:00100000:2.0:1788845447.609328:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180123648 00000100:00100000:2.0:1788845447.609426:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:2.0:1788845447.609437:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+11:10457:x1875740180123648:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845447.609534:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845447.609556:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c9e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523e0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.610076:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.610095:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.610108:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845447.610121:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788845447.610832:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.610843:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.610851:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.610878:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845447.610883:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.610890:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.610902:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8e500) 00010000:00010000:2.0:1788845447.610905:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845447.610909:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ca5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.610914:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.610963:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c9e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523e0 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.610985:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:2.0:1788845447.610987:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845447.610991:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9c9e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523e0 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.611000:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1e00, rc 0) 00000100:00100000:2.0:1788845447.611119:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+12:10457:x1875740180123648:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 1683us (1927us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788845447.611128:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:0.0:1788845447.627508:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845447.627777:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180123776 00000100:00100000:2.0:1788845447.627800:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180123776 00000100:00100000:2.0:1788845447.627866:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 71 00000100:00100000:2.0:1788845447.627877:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+12:10457:x1875740180123776:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788845447.627914:0:7234:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788845447.628270:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+12:10457:x1875740180123776:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 393us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845447.628279:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 71 00000100:00100000:3.0:1788845447.631985:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.632426:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180124032 00000100:00100000:1.0:1788845447.632437:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180124032 00000100:00100000:1.0:1788845447.632489:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 72 00000100:00100000:1.0:1788845447.632498:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+12:10457:x1875740180124032:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845447.632518:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845447.632538:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788845447.632564:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9c58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523d2 expref: 12 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.632586:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:1.0:1788845447.632591:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845447.632604:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9cb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523e7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845447.633823:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788845447.634097:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9cba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.634112:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.634123:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.634188:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9cb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523e7 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.634204:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9cba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523e7 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.634212:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:1.0:1788845447.634215:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845447.634217:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09c00, rc 0) 00000100:00100000:1.0:1788845447.634278:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+13:10457:x1875740180124032:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 1780us (2318us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788845447.634295:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 72 00000100:00100000:1.0:1788845447.639302:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845447.639400:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180124288 00000100:00100000:2.0:1788845447.639410:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180124288 00000100:00100000:2.0:1788845447.639474:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:2.0:1788845447.639486:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+13:10457:x1875740180124288:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788845447.639542:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845447.639566:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9cba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523e7 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.639592:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:2.0:1788845447.639602:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845447.639624:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9cc8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.639636:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.639646:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.639683:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ccf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1541bbdf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.639714:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1541bbdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.639722:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1541bbdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.639951:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.639959:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9cc8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.639965:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9cc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.639982:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845447.639986:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9cc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.639994:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9cc8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.640004:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845447.640007:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845447.640010:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9cc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.640016:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9cc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.640026:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1541bbdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.640038:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ccf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1541bbdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.640043:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1541bbdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.640047:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845447.640050:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1541bbdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.640055:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ccf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1541bbdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.640063:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1541bbdf (ffff92ae931baf00) 00010000:00010000:2.0:1788845447.640066:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845447.640068:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ccf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1541bbdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.640073:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ccf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1541bbdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845447.640313:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+12:10457:x1875740180124288:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 828us (1117us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788845447.640321:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:2.0:1788845447.643051:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845447.643115:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180124416 00000100:00100000:3.0:1788845447.643125:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180124416 00000100:00100000:3.0:1788845447.643190:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:3.0:1788845447.643199:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+12:10457:x1875740180124416:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845447.643217:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845447.643254:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9cd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523ee expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.643289:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9cdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.643301:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9cdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.643312:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9cdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.643437:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9cd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523ee expref: 14 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.643455:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9cdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523ee expref: 13 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.643463:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae90a6fe00) 00010000:00010000:3.0:1788845447.643466:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788845447.643469:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b800, rc 0) 00000100:00100000:3.0:1788845447.643838:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+13:10457:x1875740180124416:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 638us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845447.643845:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:2.0:1788845447.650140:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.650241:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180124672 00000100:00100000:1.0:1788845447.650251:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180124672 00000100:00100000:1.0:1788845447.650311:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 75 00000100:00100000:1.0:1788845447.650321:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+13:10457:x1875740180124672:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788845447.650413:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9ce4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.650431:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.650443:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788845447.650741:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788845447.650753:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 256870390024ns, next at 257870387593ns, rc = 0 00000004:00010000:1.0:1788845447.650841:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9fbb93e reply state 00000000cb310a0b transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845447.650852:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788845447.651058:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+15:10457:x1875740180124672:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 738us (930us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788845447.651066:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 75 00010000:00010000:2.0:1788845447.653255:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.653273:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9ce4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.653300:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9ce4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.653306:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845447.653311:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9ce4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.653319:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9ce4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.653334:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae90a6fe00) 00010000:00010000:2.0:1788845447.653337:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788845447.653341:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9ce4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.653347:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9ce4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845447.655011:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845447.655444:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180124800 00000100:00100000:0.0:1788845447.655454:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180124800 00000100:00100000:0.0:1788845447.655521:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:0.0:1788845447.655532:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+14:10457:x1875740180124800:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845447.655556:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845447.655576:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9ceb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.655648:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9ceb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523f5 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.655679:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9ceb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523f5 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.655700:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae90a6fe00) 00010000:00010000:0.0:1788845447.655704:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788845447.655707:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030200, rc 0) 00000100:00100000:0.0:1788845447.655770:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+15:10457:x1875740180124800:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 241us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845447.655778:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:0.0:1788845447.657984:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.658056:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180124928 00000100:00100000:1.0:1788845447.658066:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180124928 00000100:00100000:1.0:1788845447.658106:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:1.0:1788845447.658113:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2371:x1875740180124928:12345-192.168.206.35@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788845447.658153:0:6658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:1.0:1788845447.658186:0:6658:0:(genops.c:1385:class_connect()) connect: client 704fd1fa-8fb6-403c-867f-b875231088ec, cookie 0xd8041b54d6df9cf2 00002000:00100000:1.0:1788845447.658198:0:6658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 704fd1fa-8fb6-403c-867f-b875231088ec/ffff92aeb4235000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788845447.658209:0:6658:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788845447.658489:0:6658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788845447.658517:0:6658:0:(import.c:65:import_set_state_nolock()) ffff92aeb4234800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845447.658762:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2371:x1875740180124928:12345-192.168.206.35@tcp:8:lhsmtool_posix.0 Request processed in 647us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845447.658770:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:2.0:1788845447.660538:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845447.660696:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180125056 00000100:00100000:0.0:1788845447.660704:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180125056 00000100:00100000:0.0:1788845447.660814:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:0.0:1788845447.660827:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:0:x1875740180125056:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788845447.661013:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788845447.683331:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1788845447.683351:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00000100:00100000:0.0:1788845447.683504:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+5:0:x1875740180125056:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 22675us (22967us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788845447.683516:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:2.0:1788845447.687128:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.687556:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180125312 00000100:00100000:1.0:1788845447.687567:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180125312 00000100:00100000:1.0:1788845447.687678:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:1.0:1788845447.687690:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+15:10457:x1875740180125312:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788845447.687940:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+16:10457:x1875740180125312:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 253us (822us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788845447.687949:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:1.0:1788845447.690080:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845447.690150:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180125568 00000100:00100000:3.0:1788845447.690159:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180125568 00000100:00100000:3.0:1788845447.690215:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 77 00000100:00100000:3.0:1788845447.690225:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+16:10457:x1875740180125568:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788845447.690336:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+16:10457:x1875740180125568:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 112us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845447.690390:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 77 00000100:00100000:2.0:1788845447.693154:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.693446:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180125696 00000100:00100000:1.0:1788845447.693456:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180125696 00000100:00100000:1.0:1788845447.693510:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:1.0:1788845447.693519:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+16:10457:x1875740180125696:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845447.693539:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845447.693558:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9cf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077523fc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.693719:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.693732:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.693743:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845447.693780:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845447.693799:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.693824:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9cf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523fc expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.693843:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523fc expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.693851:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae90a6fe00) 00010000:00010000:1.0:1788845447.693854:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788845447.693862:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09e00, rc 0) 00000100:00100000:1.0:1788845447.694024:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+17:10457:x1875740180125696:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 505us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845447.694032:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:0.0:1788845447.696605:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.696726:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180125824 00000100:00100000:1.0:1788845447.696824:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180125824 00000100:00100000:1.0:1788845447.696875:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:1.0:1788845447.696899:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180125824:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845447.696916:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845447.696940:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6df9d07 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752403 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788845447.696976:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9d87, blocks: 0x1 00010000:00010000:1.0:1788845447.696993:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=256s v=(0 0) 00010000:00010000:1.0:1788845447.696997:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845447.697005:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6df9d07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752403 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.697022:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6df9d07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752403 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.697034:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09a00, rc 0) 00000100:00100000:1.0:1788845447.697086:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180125824:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 188us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845447.697092:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:0.0:1788845447.699790:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.700023:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180126080 00000100:00100000:1.0:1788845447.700032:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180126080 00000100:00100000:1.0:1788845447.700117:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:1.0:1788845447.700127:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+17:10457:x1875740180126080:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788845447.700228:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+17:10457:x1875740180126080:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 101us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845447.700235:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:3.0:1788845447.702294:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845447.702388:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180126208 00000100:00100000:2.0:1788845447.702397:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180126208 00000100:00100000:2.0:1788845447.702440:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:2.0:1788845447.702448:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:10457:x1875740180126208:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845447.702482:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845447.702497:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775240a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.702524:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6df9d07 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752403 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.702532:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845447.702536:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845447.702540:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.702570:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6df9d07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752403 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.702581:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6df9d07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752403 expref: 7 pid: 6658 timeout: 356 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845447.702593:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadfac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1875740189582080:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845447.702680:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845447.704495:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadfac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1875740189582080:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845447.704527:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.704546:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0800, rc 0) 00000100:00100000:2.0:1788845447.704655:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:10457:x1875740180126208:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 2206us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845447.704664:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:0.0:1788845447.705321:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845447.706149:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180126336 00000100:00100000:2.0:1788845447.706158:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180126336 00010000:00010000:2.0:1788845447.706196:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6df9d07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752403 expref: 7 pid: 6658 timeout: 356 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845447.706234:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:2.0:1788845447.706243:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180126336:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845447.706256:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845447.706564:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6df9d07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752403 expref: 7 pid: 6658 timeout: 356 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.706581:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6df9d07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752403 expref: 7 pid: 6658 timeout: 356 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.706603:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6df9d07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752403 expref: 7 pid: 6658 timeout: 356 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.706620:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845447.706625:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845447.706686:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.706699:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.707895:0:8419:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845447.707916:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadfac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8419:1875740189582208:192.168.206.35@tcp:105: 00000100:00100000:2.0:1788845447.708003:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845447.712126:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845447.712261:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadfac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8419:1875740189582208:192.168.206.35@tcp:105: 00010000:00010000:2.0:1788845447.712285:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845447.712331:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180126464 00000100:00100000:3.0:1788845447.712338:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180126464 00002000:00100000:3.0:1788845447.712458:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff92aebc8e0e00 x1875740180126464/t0(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:553/0 lens 504/0 e 0 to 0 dl 1788845458 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845447.712468:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aebc8e0e00 with x1875740180126464 ext(0->8) 00002000:00010000:3.0:1788845447.712473:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aebc8e0e00 00000100:00100000:3.0:1788845447.712546:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:3.0:1788845447.712554:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180126464:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788845447.712621:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180126336:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 6378us (7302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845447.712630:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:3.0:1788845447.713260:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180126464:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 Request processed in 704us (1148us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788845447.713269:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00002000:00100000:3.0:1788845447.713277:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff92aebc8e0e00 x1875740180126464/t4294967302(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:553/0 lens 504/448 e 0 to 0 dl 1788845458 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845447.713285:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aebc8e0e00 with x1875740180126464 ext(0->8) 00002000:00010000:3.0:1788845447.713288:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aebc8e0e00 00000100:00100000:0.0:1788845447.716313:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845447.716515:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180126592 00000100:00100000:3.0:1788845447.716524:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180126592 00000100:00100000:2.0:1788845447.716761:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 80 00000100:00100000:2.0:1788845447.716773:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+17:10457:x1875740180126592:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 00000020:00080000:1.0:1788845447.742217:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788845447.742264:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788845447.742275:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:1.0:1788845447.742313:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788845447.742321:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1788845447.742439:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+15:10457:x1875740180126592:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 Request processed in 25662us (26130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845447.742451:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 80 00000100:00100000:0.0:1788845447.743041:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189582336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788845447.743094:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845447.744210:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189582336 00000100:00100000:3.0:1788845447.744220:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189582336 00000100:00100000:3.0:1788845447.744272:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788845447.744282:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189582336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788845447.744476:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788845447.744480:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788845447 00002000:00010000:3.0:1788845447.744483:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788845447.744486:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788845447 -> 1788845447 00002000:00010000:3.0:1788845447.744488:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788845447.744545:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189582336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 265us (1450us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788845447.744553:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788845447.744616:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92aebc847b80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788845447.744623:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189582336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788845447.744814:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845447.745050:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180126720 00000100:00100000:0.0:1788845447.745055:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180126720 00000100:00100000:0.0:1788845447.745092:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:0.0:1788845447.745100:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+8:2374:x1875740180126720:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788845447.775096:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788845447.775113:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788845447.776042:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180126720:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 Request processed in 30933us (31220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845447.776054:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:0.0:1788845447.779040:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.779126:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180126976 00000100:00100000:1.0:1788845447.779136:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180126976 00000100:00100000:1.0:1788845447.779360:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 81 00000100:00100000:1.0:1788845447.779410:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+13:10457:x1875740180126976:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788845447.779463:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845447.779489:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523fc expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.779509:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae90a6fe00) 00010000:00010000:1.0:1788845447.779514:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845447.779543:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9d15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.779560:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.779570:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845447.779865:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b52293fd reply state 000000005d96cfcf transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845447.779875:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788845447.779985:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+14:10457:x1875740180126976:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 585us (954us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788845447.779992:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 81 00000100:00100000:2.0:1788845447.782961:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845447.783071:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180127104 00000100:00100000:0.0:1788845447.783081:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180127104 00000100:00100000:0.0:1788845447.783183:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:0.0:1788845447.783194:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180127104:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788845447.783509:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788845447.783513:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788845447 -> 1788845445 00002000:00010000:0.0:1788845447.783516:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788845444 00002000:00010000:0.0:1788845447.783518:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788845447 -> 1788845445 00002000:00010000:0.0:1788845447.783520:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788845447.783579:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180127104:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 387us (631us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788845447.783587:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 31 00010000:00010000:3.0:1788845447.785631:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.785661:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9d15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.785669:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.785675:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845447.785680:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.785687:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9d15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.785716:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae90a6fe00) 00010000:00010000:3.0:1788845447.785720:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845447.785726:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9d15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.785732:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9d15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845447.786853:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.787004:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180127360 00000100:00100000:1.0:1788845447.787013:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180127360 00000100:00100000:1.0:1788845447.787074:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 82 00000100:00100000:1.0:1788845447.787083:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+13:10457:x1875740180127360:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788845447.787142:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.787156:0:8176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9cdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523ee expref: 13 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.787164:0:8176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.787199:0:8176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9cdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523ee expref: 13 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.787212:0:8176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9cdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523ee expref: 13 pid: 7234 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845447.787320:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189582464:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845447.788897:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb96ab840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845447.791673:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845447.791732:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189582464:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845447.791761:0:8176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845447.792168:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180127488 00000100:00100000:2.0:1788845447.792177:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180127488 00010000:00010000:2.0:1788845447.792213:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9cdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523ee expref: 14 pid: 7234 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845447.792287:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:2.0:1788845447.792297:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+14:2373:x1875740180127488:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845447.792319:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845447.792327:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9cdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523ee expref: 14 pid: 7234 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.792339:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9cdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523ee expref: 14 pid: 7234 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.792358:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6df9cdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523ee expref: 14 pid: 7234 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.792416:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae90a6fe00) 00010000:00010000:2.0:1788845447.792420:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.792429:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.792446:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.792465:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845447.792521:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+13:2373:x1875740180127488:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 225us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845447.792528:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 43 00010000:00010000:0.0:1788845447.793733:0:8176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.793746:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.793778:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.793785:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.793792:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.793798:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845447.793803:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.793810:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.793823:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae90a6fe00) 00010000:00010000:0.0:1788845447.793826:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788845447.793830:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.793835:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9d1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845447.793913:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+12:10457:x1875740180127360:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 Request processed in 6828us (7065us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788845447.793932:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 82 00000100:00100000:1.0:1788845447.796298:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845447.796569:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180127616 00000100:00100000:0.0:1788845447.796578:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180127616 00000100:00100000:2.0:1788845447.796696:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:2.0:1788845447.796709:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+7:2375:x1875740180127616:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788845447.796752:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.796793:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.796801:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788845447.796805:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845447.796809:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.796844:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.796858:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 7 pid: 6659 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845447.796874:0:6658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadfaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1875740189582592:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845447.797023:0:6658:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88ad0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788845447.800571:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845447.800770:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180127744 00000100:00100000:0.0:1788845447.800779:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180127744 00010000:00010000:0.0:1788845447.800824:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 8 pid: 6659 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845447.800831:0:6658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadfaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1875740189582592:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845447.800856:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845447.800866:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:0.0:1788845447.800875:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+8:2372:x1875740180127744:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845447.800889:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845447.800915:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 8 pid: 6659 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.800933:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 8 pid: 6659 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.800960:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee989dab/0xd8041b54d6df9d0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775240a expref: 8 pid: 6659 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.800990:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845447.800994:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845447.800999:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.801008:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.801056:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845447.801114:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180127744:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 239us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845447.801122:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 44 00010000:00010000:1.0:1788845447.801179:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.801193:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.801218:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.801241:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.801249:0:6658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.801255:0:6658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845447.801258:0:6658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.801267:0:6658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.801278:0:6658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.801285:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0e85153/0xd8041b54d6df9d23 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845447.801356:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2375:x1875740180127616:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 Request processed in 4648us (5068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845447.801576:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:2.0:1788845447.805105:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845447.806348:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180128000 00000100:00100000:0.0:1788845447.806374:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180128000 00000100:00100000:0.0:1788845447.806480:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:0.0:1788845447.806491:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+12:10457:x1875740180128000:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788845447.806567:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.806583:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.806594:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.806886:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.806897:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9ceb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523f5 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.806905:0:7234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.806938:0:7234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9ceb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523f5 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.806962:0:7234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9ceb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523f5 expref: 13 pid: 5818 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845447.806990:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189582720:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845447.807077:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845447.810118:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845447.810220:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189582720:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845447.810248:0:7234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845447.810355:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180128128 00000100:00100000:2.0:1788845447.810388:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180128128 00010000:00010000:2.0:1788845447.810424:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9ceb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523f5 expref: 14 pid: 5818 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845447.810455:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:2.0:1788845447.810464:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+14:2372:x1875740180128128:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845447.810496:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845447.810503:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9ceb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523f5 expref: 14 pid: 5818 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.810515:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9ceb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523f5 expref: 14 pid: 5818 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.810536:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9ceb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523f5 expref: 14 pid: 5818 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.810553:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae90a6fe00) 00010000:00010000:2.0:1788845447.810558:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.810566:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.810572:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.810593:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845447.810659:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+13:2372:x1875740180128128:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 196us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845447.810666:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 45 00010000:00010000:0.0:1788845447.810784:0:7234:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.810792:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845447.811002:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788845447.811143:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788845447.811191:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788845447.811286:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189582848:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788845447.811345:0:7234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845447.811408:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c99000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845447.812088:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189582848 00000100:00100000:2.0:1788845447.812095:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189582848 00000100:00100000:2.0:1788845447.812140:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845447.812148:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7234:x1875740189582848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788845447.812243:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7234:x1875740189582848:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845447.812258:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788845447.812355:0:7234:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788845447.812394:0:7234:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92aebc847b80, transno 4294967303 00000100:00100000:0.0:1788845447.812405:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189582848:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788845447.813869:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788845447.813952:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189582976:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788845447.814027:0:7234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845447.814102:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788845447.815005:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189582976 00000100:00100000:2.0:1788845447.815015:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189582976 00000100:00100000:2.0:1788845447.815076:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788845447.815086:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7234:x1875740189582976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788845447.815482:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7234:x1875740189582976:12345-0@lo:1000:mdt00_003.0 Request processed in 396us (1454us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788845447.815490:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845447.816017:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189582976:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788845447.816057:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816067:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816075:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816081:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845447.816086:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816093:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816108:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae90a6fe00) 00010000:00010000:0.0:1788845447.816111:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788845447.816115:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816121:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d31 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816161:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9c5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816167:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9c5f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816195:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9c5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816200:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845447.816203:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9c5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816209:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9c5f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816219:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8e500) 00010000:00010000:0.0:1788845447.816221:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788845447.816224:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9c5f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816230:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9c5f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816251:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816265:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077523d9 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816274:0:7234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816305:0:7234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523d9 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.816331:0:7234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523d9 expref: 16 pid: 5819 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845447.816344:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189583104:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845447.816591:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845447.818941:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189583104:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845447.818981:0:7234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845447.820077:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845447.820549:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180128256 00000100:00100000:1.0:1788845447.820559:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180128256 00010000:00010000:1.0:1788845447.820674:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523d9 expref: 17 pid: 5819 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845447.820755:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:1.0:1788845447.820765:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+17:2373:x1875740180128256:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845447.820778:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845447.820784:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523d9 expref: 17 pid: 5819 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.820796:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523d9 expref: 17 pid: 5819 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.820816:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9c7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077523d9 expref: 17 pid: 5819 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.820832:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8e500) 00010000:00010000:1.0:1788845447.820836:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.820845:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.820872:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845447.820905:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845447.820955:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+16:2373:x1875740180128256:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 192us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845447.820962:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 46 00010000:00010000:3.0:1788845447.821027:0:7234:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821035:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821047:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821053:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821060:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821065:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845447.821069:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821075:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821084:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8e500) 00010000:00010000:3.0:1788845447.821085:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845447.821089:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821092:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d38 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821108:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821111:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821115:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821118:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845447.821119:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821123:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821127:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8e500) 00010000:00010000:3.0:1788845447.821128:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788845447.821130:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845447.821133:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788845447.821436:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788845447.821441:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788845447.821469:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788845447.821474:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788845447.821541:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+15:10457:x1875740180128000:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 15052us (16450us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788845447.821558:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 83 00000020:00080000:3.0:1788845447.821563:0:7234:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788845447.826161:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845447.826320:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180128512 00000100:00100000:0.0:1788845447.826330:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180128512 00000100:00100000:0.0:1788845447.826512:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:0.0:1788845447.826523:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+15:10457:x1875740180128512:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788845447.827427:0:5821:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788845447.827549:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788845447.827596:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.827803:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.827815:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.827823:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.827842:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.827849:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845447.827876:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788845447.827984:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+17:10457:x1875740180128512:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 1461us (1834us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788845447.827992:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00000020:00080000:0.0:1788845447.827997:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788845447.828084:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845447.828091:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.828098:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030e00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845447.828102:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.828110:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.828122:0:8418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:2.0:1788845447.828125:0:8418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788845447.828129:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d3f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.828134:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6df9d3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845447.828150:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845447.828152:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845447.828153:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845448.027639:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788845449.002722:0:12013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845449.002732:0:12013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788845449.002763:0:12013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788845449.002768:0:12013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788845449.051483:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845449.091217:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845449.091292:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180128768 00000100:00100000:2.0:1788845449.091302:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180128768 00000100:00100000:2.0:1788845449.091394:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:2.0:1788845449.091403:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+17:10475:x1875740180128768:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845449.091430:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845449.091448:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.091562:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0800/0xd8041b54d6df9d4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.091585:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0800/0xd8041b54d6df9d4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.091596:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0800/0xd8041b54d6df9d4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845449.091606:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00080000:1.0:1788845449.091637:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788845449.091743:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752411 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.091760:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0800/0xd8041b54d6df9d4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752411 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.091768:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845449.091772:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788845449.091775:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0800, rc 0) 00000100:00100000:2.0:1788845449.091839:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+19:10475:x1875740180128768:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 437us (635us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788845449.091859:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:3.0:1788845449.094858:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.095154:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180128896 00000100:00100000:1.0:1788845449.095162:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180128896 00000100:00100000:1.0:1788845449.095401:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 85 00000100:00100000:1.0:1788845449.095411:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+19:10475:x1875740180128896:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:1.0:1788845449.095480:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9d5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.095495:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9d5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.095504:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9d5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.095518:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9d62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.095537:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.095543:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097482:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9d69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097500:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097510:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845449.097556:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097570:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9d5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097578:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9d5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097584:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9d5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097591:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.097596:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9d5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097604:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9d5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097624:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:1.0:1788845449.097627:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845449.097631:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9d5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097637:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9d5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097649:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097655:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9d62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097661:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097666:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.097669:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097675:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9d62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097682:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae93b8e100) 00010000:00010000:1.0:1788845449.097685:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845449.097688:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9d62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097693:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6df9d62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097724:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097731:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9d69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097737:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097742:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.097745:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097751:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9d69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097759:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8ed00) 00010000:00010000:1.0:1788845449.097762:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845449.097764:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9d69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.097770:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6df9d69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.097860:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+19:10475:x1875740180128896:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 2446us (3012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.097871:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 85 00000100:00100000:1.0:1788845449.134712:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845449.134794:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180129152 00000100:00100000:0.0:1788845449.134804:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180129152 00000100:00100000:0.0:1788845449.134874:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 86 00000100:00100000:0.0:1788845449.134886:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+19:10478:x1875740180129152:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845449.134907:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845449.134927:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752418 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135021:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135035:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135051:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135079:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9d7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135088:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135097:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135521:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135532:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135539:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845449.135550:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788845449.135703:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135711:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135717:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135724:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845449.135728:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135747:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135759:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:0.0:1788845449.135763:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845449.135767:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135775:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9d77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135788:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135794:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9d7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135800:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135806:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845449.135809:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135815:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9d7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135824:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae83de9300) 00010000:00010000:0.0:1788845449.135828:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845449.135831:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9d7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135847:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9d7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135892:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752418 expref: 22 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135907:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752418 expref: 21 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.135914:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:0.0:1788845449.135916:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845449.135919:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031800, rc 0) 00000100:00100000:0.0:1788845449.136000:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+21:10478:x1875740180129152:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1116us (1313us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788845449.136008:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 86 00000100:00100000:0.0:1788845449.140296:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845449.140430:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180129280 00000100:00100000:0.0:1788845449.140439:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180129280 00000100:00100000:0.0:1788845449.140506:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:0.0:1788845449.140518:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+21:10478:x1875740180129280:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:0.0:1788845449.140583:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.140600:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.140612:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.140648:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.140655:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9d93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.140663:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.140669:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845449.140675:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.140683:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9d93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.140695:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:0.0:1788845449.140699:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845449.140703:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9d93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.140710:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9d93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845449.140780:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+21:10478:x1875740180129280:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 264us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845449.140787:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:0.0:1788845449.147887:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845449.147939:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180129536 00000100:00100000:3.0:1788845449.147949:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180129536 00000100:00100000:3.0:1788845449.148023:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:3.0:1788845449.148034:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+21:10478:x1875740180129536:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:3.0:1788845449.149396:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+22:10478:x1875740180129536:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 1356us (1513us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788845449.149407:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:1.0:1788845449.185357:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845449.185451:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180129792 00000100:00100000:0.0:1788845449.185460:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180129792 00000100:00100000:0.0:1788845449.185552:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:0.0:1788845449.185564:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+22:9998:x1875740180129792:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1788845449.185587:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845449.185606:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d9a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775241f expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.185708:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.185732:0:8176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9d85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752418 expref: 23 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.185742:0:8176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.185779:0:8176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752418 expref: 23 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.185793:0:8176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9d85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752418 expref: 23 pid: 7234 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845449.185812:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189583232:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845449.185931:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9eaa1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845449.189212:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845449.189488:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180129920 00000100:00100000:1.0:1788845449.189494:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189583232:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845449.189496:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180129920 00010000:00010000:2.0:1788845449.189533:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9d85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752418 expref: 24 pid: 7234 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.189537:0:8176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845449.189712:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:2.0:1788845449.189722:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+24:2372:x1875740180129920:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845449.189738:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845449.189745:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9d85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752418 expref: 24 pid: 7234 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.189759:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752418 expref: 24 pid: 7234 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.189780:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752418 expref: 24 pid: 7234 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.189796:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:2.0:1788845449.189800:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.189809:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.189817:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.189855:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845449.189911:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+23:2372:x1875740180129920:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 190us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845449.189919:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 47 00010000:00010000:1.0:1788845449.190278:0:8176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.190287:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845449.190305:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788845449.190703:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9d9a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775241f expref: 24 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.190720:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775241f expref: 23 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.190728:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:1.0:1788845449.190730:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788845449.190733:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030200, rc 0) 00000100:00100000:1.0:1788845449.190778:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+23:9998:x1875740180129792:12345-192.168.206.35@tcp:101:bash.0 Request processed in 5218us (5537us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788845449.190786:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:0.0:1788845449.196021:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845449.196203:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180130176 00000100:00100000:3.0:1788845449.196214:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180130176 00000100:00100000:0.0:1788845449.196341:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 89 00000100:00100000:0.0:1788845449.196355:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+23:9998:x1875740180130176:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:0.0:1788845449.196852:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9daf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.196886:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.196898:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845449.197097:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788845449.197228:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1b6f34d reply state 00000000b790039d transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845449.197238:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788845449.197323:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788845449.197685:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+27:9998:x1875740180130176:12345-192.168.206.35@tcp:36:bash.0 Request processed in 1333us (1760us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788845449.197693:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 89 00000020:00080000:0.0:1788845449.197697:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788845449.205274:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845449.205581:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180130304 00000100:00100000:3.0:1788845449.205591:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180130304 00000100:00100000:3.0:1788845449.205667:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 90 00000100:00100000:3.0:1788845449.205678:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+27:9998:x1875740180130304:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1788845449.205701:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845449.205720:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9db6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752426 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.205780:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752426 expref: 28 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.205795:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752426 expref: 28 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.205841:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:3.0:1788845449.205845:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845449.205848:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748ba00, rc 0) 00000100:00100000:3.0:1788845449.205912:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+28:9998:x1875740180130304:12345-192.168.206.35@tcp:101:bash.0 Request processed in 235us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845449.205919:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 90 00010000:00010000:2.0:1788845449.205997:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9daf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.206006:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9daf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.206014:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9daf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.206019:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845449.206024:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9daf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.206031:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9daf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.206043:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:2.0:1788845449.206045:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845449.206049:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9daf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.206054:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9daf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.208705:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845449.210156:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180130432 00000100:00100000:0.0:1788845449.210172:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180130432 00000100:00100000:0.0:1788845449.210327:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:0.0:1788845449.210340:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:9998:x1875740180130432:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1788845449.210358:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845449.210397:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6df9dbd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775242d expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788845449.210428:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f9d85, atime: 0x6a9f9d84, ctime: 0x6a9f9d85, blocks: 0xb 00010000:00010000:0.0:1788845449.210452:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=258s v=(0 0) 00010000:00010000:0.0:1788845449.210468:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845449.210495:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6df9dbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775242d expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.210516:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6df9dbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775242d expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.210530:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845449.210601:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:9998:x1875740180130432:12345-192.168.206.35@tcp:101:bash.0 Request processed in 263us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845449.210608:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00080000:1.0:1788845449.211859:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845449.213687:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845449.213826:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180130560 00000100:00100000:2.0:1788845449.213836:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180130560 00002000:00010000:2.0:1788845449.213905:0:6662:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788845449.213913:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeb74e0a80 with x1875740180130560 ext(0->18446744073709551615) 00002000:00010000:2.0:1788845449.213924:0:6662:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeb74e0a80. 00000100:00100000:2.0:1788845449.213957:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:2.0:1788845449.213983:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:2374:x1875740180130560:12345-192.168.206.35@tcp:10:bash.0 00002000:00010000:2.0:1788845449.214295:0:6662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788845449.214300:0:6662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788845445 -> 1788845448 00002000:00010000:2.0:1788845449.214303:0:6662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788845444 -> 1788845444 00002000:00010000:2.0:1788845449.214305:0:6662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788845445 -> 1788845448 00002000:00010000:2.0:1788845449.214307:0:6662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788845449.214403:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:704fd1fa-8fb6-403c-867f-b875231088ec+8:2374:x1875740180130560:12345-192.168.206.35@tcp:10:bash.0 Request processed in 421us (725us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788845449.214411:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00002000:00010000:2.0:1788845449.214414:0:6662:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788845449.214417:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeb74e0a80 with x1875740180130560 ext(0->18446744073709551615) 00002000:00010000:2.0:1788845449.214422:0:6662:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeb74e0a80. 00000100:00100000:2.0:1788845449.277115:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.277211:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180130688 00000100:00100000:1.0:1788845449.277220:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180130688 00000100:00100000:1.0:1788845449.277331:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 91 00000100:00100000:1.0:1788845449.277343:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+27:10492:x1875740180130688:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:1.0:1788845449.277449:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9dc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277482:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277493:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277510:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9dcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277517:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277523:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277775:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277785:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277793:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845449.277833:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277845:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277851:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9dc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277867:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277872:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.277876:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277884:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277896:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:1.0:1788845449.277899:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845449.277902:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9dc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277908:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9dc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277922:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277928:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9dcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277934:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9dcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277939:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.277942:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9dcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277968:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9dcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277978:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae93b8ed00) 00010000:00010000:1.0:1788845449.277980:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845449.277984:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9dcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.277990:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9dcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.278003:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.278009:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.278015:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.278020:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.278023:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.278029:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.278037:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:1.0:1788845449.278039:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845449.278042:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.278056:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.278186:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+27:10492:x1875740180130688:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 844us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.278194:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 91 00000100:00100000:1.0:1788845449.306686:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845449.306785:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180130944 00000100:00100000:0.0:1788845449.306797:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180130944 00000100:00100000:0.0:1788845449.306863:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 92 00000100:00100000:0.0:1788845449.306875:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+27:10495:x1875740180130944:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845449.306896:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845449.306916:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9dd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752434 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307003:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9de0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307016:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307027:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307042:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9de7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307065:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307073:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307404:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9dee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307416:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307423:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845449.307433:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788845449.307527:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307535:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9de0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307542:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9de0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307549:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845449.307553:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9de0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307560:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9de0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307583:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:0.0:1788845449.307586:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845449.307590:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9de0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307597:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6df9de0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307611:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307617:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9de7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307623:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307629:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845449.307632:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307637:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9de7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307644:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae83de9000) 00010000:00010000:0.0:1788845449.307646:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845449.307649:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9de7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.307654:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6df9de7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.308084:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6df9dd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752434 expref: 30 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.308102:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752434 expref: 29 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.308110:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:0.0:1788845449.308113:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788845449.308115:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030600, rc 0) 00000100:00100000:0.0:1788845449.308258:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+29:10495:x1875740180130944:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1386us (1583us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788845449.308267:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 92 00000100:00100000:0.0:1788845449.317571:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.322533:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180131072 00000100:00100000:1.0:1788845449.322615:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180131072 00000100:00100000:1.0:1788845449.322687:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:1.0:1788845449.322697:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+29:10495:x1875740180131072:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:1.0:1788845449.322769:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.322787:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775241f expref: 29 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.322796:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.322830:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775241f expref: 29 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.322844:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775241f expref: 29 pid: 8176 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.322874:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189583360:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845449.324121:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb96ab180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845449.330756:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.330893:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189583360:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845449.330924:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845449.334077:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180131328 00000100:00100000:3.0:1788845449.334095:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180131328 00000100:00100000:3.0:1788845449.334171:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:3.0:1788845449.334182:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+30:5612:x1875740180131328:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788845449.335525:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+31:5612:x1875740180131328:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 1336us (4771us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788845449.336209:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:3.0:1788845449.339280:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845449.340864:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180131456 00000100:00100000:2.0:1788845449.340880:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180131456 00010000:00010000:2.0:1788845449.340931:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775241f expref: 31 pid: 8176 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845449.341133:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:2.0:1788845449.341144:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+31:2373:x1875740180131456:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845449.341160:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845449.341193:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775241f expref: 31 pid: 8176 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.341207:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775241f expref: 31 pid: 8176 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.341229:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6df9da1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775241f expref: 31 pid: 8176 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.341250:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:2.0:1788845449.341255:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.341264:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.341272:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.341304:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845449.341431:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.341441:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.341474:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.341481:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.341487:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.341493:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.341497:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.341504:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.341513:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:1.0:1788845449.341516:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845449.341519:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.341544:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845449.341828:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+30:2373:x1875740180131456:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 683us (2558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845449.341836:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:1.0:1788845449.342630:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+29:10495:x1875740180131072:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 19929us (25127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.342640:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:0.0:1788845449.346864:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.346950:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180131712 00000100:00100000:1.0:1788845449.346969:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180131712 00000100:00100000:1.0:1788845449.347072:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:1.0:1788845449.347083:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+29:10495:x1875740180131712:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:1.0:1788845449.347346:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+30:10495:x1875740180131712:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 264us (493us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788845449.347354:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:0.0:1788845449.428621:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.428912:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180131968 00000100:00100000:1.0:1788845449.428922:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180131968 00000100:00100000:1.0:1788845449.428993:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00100000:1.0:1788845449.429003:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+30:10506:x1875740180131968:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:1.0:1788845449.429026:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845449.429046:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775243b expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429231:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429246:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429280:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429296:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429305:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429312:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429716:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429728:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429736:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845449.429746:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788845449.429840:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429847:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429853:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429859:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.429869:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429877:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429889:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:1.0:1788845449.429891:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845449.429895:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429901:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429916:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429922:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429926:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429931:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.429934:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429939:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429946:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae93b8ed00) 00010000:00010000:1.0:1788845449.429948:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845449.429967:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.429974:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.430016:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775243b expref: 33 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.430030:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775243b expref: 32 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.430037:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:1.0:1788845449.430039:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845449.430041:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08400, rc 0) 00000100:00100000:1.0:1788845449.430171:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+32:10506:x1875740180131968:12345-192.168.206.35@tcp:101:cat.0 Request processed in 1169us (1564us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788845449.430180:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00100000:2.0:1788845449.437218:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845449.437325:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180132224 00000100:00100000:3.0:1788845449.437336:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180132224 00000100:00100000:3.0:1788845449.437424:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:3.0:1788845449.437435:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+32:10506:x1875740180132224:12345-192.168.206.35@tcp:35:cat.0 00000100:00100000:3.0:1788845449.437695:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+33:10506:x1875740180132224:12345-192.168.206.35@tcp:35:cat.0 Request processed in 262us (493us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788845449.437703:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:0.0:1788845449.464433:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.464668:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180132480 00000100:00100000:1.0:1788845449.464678:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180132480 00000100:00100000:1.0:1788845449.464742:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 95 00000100:00100000:1.0:1788845449.464752:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+33:10507:x1875740180132480:12345-192.168.206.35@tcp:36:rm.0 00010000:00010000:1.0:1788845449.464837:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788845449.464862:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775243b expref: 33 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.464886:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6df9dee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752434 expref: 32 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.464918:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6df9db6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752426 expref: 31 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.464928:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae83de9c00) 00010000:00010000:1.0:1788845449.464939:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845449.464968:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.464981:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.464990:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.465011:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.465019:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.465038:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.465625:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.465637:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.465645:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788845449.467209:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1788845449.467223:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 258686859614ns, next at 259686856814ns, rc = 0 00010000:00010000:1.0:1788845449.467293:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9e3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467307:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9e3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467317:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9e3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467325:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9e3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467331:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9e3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467337:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9e3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467393:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788845449.467414:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467421:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467427:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467432:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.467445:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467453:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467465:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8e100) 00010000:00010000:1.0:1788845449.467480:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788845449.467485:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467492:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467513:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467519:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467525:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467530:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.467533:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467540:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467548:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:1.0:1788845449.467551:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845449.467560:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.467567:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845449.467578:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd3baf22 reply state 00000000679daab8 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.467587:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788845449.468542:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+32:10507:x1875740180132480:12345-192.168.206.35@tcp:36:rm.0 Request processed in 3782us (4114us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788845449.468554:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 95 00010000:00010000:2.0:1788845449.468657:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845449.468664:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9e3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.468671:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09c00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845449.468674:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9e3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.468691:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9e3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.468702:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ae93b8e100) 00010000:00010000:2.0:1788845449.468705:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788845449.468708:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9e3b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.468713:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9e3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.468730:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845449.468731:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845449.468732:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845449.472098:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.472117:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.472268:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.472275:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845449.472280:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.472287:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.472302:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae93b8ed00) 00010000:00010000:3.0:1788845449.472305:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845449.472309:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.472315:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9e2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845449.520327:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.520531:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180132736 00000100:00100000:1.0:1788845449.520541:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180132736 00000100:00100000:1.0:1788845449.520603:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 96 00000100:00100000:1.0:1788845449.520614:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+31:10513:x1875740180132736:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1788845449.520638:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845449.520658:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752442 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.520780:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.520795:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.520805:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.520819:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.520836:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.520844:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845449.521739:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788845449.521917:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9e57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.521930:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.521940:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.522073:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.522080:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.522086:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.522092:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.522096:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.522104:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.522126:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:1.0:1788845449.522327:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845449.522433:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.522441:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845449.522457:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040115af6 reply state 000000004241a751 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.522466:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788845449.522500:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752442 expref: 34 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.522515:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752442 expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.522523:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8eb00) 00010000:00010000:1.0:1788845449.522525:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845449.522527:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09600, rc 0) 00000100:00100000:1.0:1788845449.522605:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+34:10513:x1875740180132736:12345-192.168.206.35@tcp:101:bash.0 Request processed in 1992us (2289us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788845449.522613:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 96 00010000:00010000:2.0:1788845449.524118:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.524282:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.524290:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.524296:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845449.524300:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.524308:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.524322:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae93b8e800) 00010000:00010000:2.0:1788845449.524527:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845449.524533:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.524539:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9e50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845449.525683:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.526982:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180132864 00000100:00100000:1.0:1788845449.526997:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180132864 00000100:00100000:1.0:1788845449.527141:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:1.0:1788845449.527153:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180132864:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1788845449.527199:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845449.527474:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7108c3a/0xd8041b54d6df9e65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752449 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788845449.527505:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788845449.527524:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=258s v=(0 0) 00010000:00010000:1.0:1788845449.527529:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845449.527539:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7108c3a/0xd8041b54d6df9e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752449 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.527558:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7108c3a/0xd8041b54d6df9e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752449 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.527570:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09a00, rc 0) 00000100:00080000:2.0:1788845449.527676:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845449.527996:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180132864:12345-192.168.206.35@tcp:101:bash.0 Request processed in 844us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.528004:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:0.0:1788845449.532768:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845449.533109:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180132992 00000100:00100000:3.0:1788845449.533119:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180132992 00000100:00100000:3.0:1788845449.533175:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:3.0:1788845449.533184:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:10513:x1875740180132992:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1788845449.533200:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845449.533217:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752450 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.533247:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7108c3a/0xd8041b54d6df9e65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752449 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.533276:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845449.533279:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845449.533284:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.533316:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7108c3a/0xd8041b54d6df9e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752449 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.533328:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7108c3a/0xd8041b54d6df9e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752449 expref: 7 pid: 6658 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845449.533341:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1875740189583488:192.168.206.35@tcp:104: 00000100:00100000:3.0:1788845449.533489:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae909190c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845449.538331:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.538402:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180133120 00000100:00100000:1.0:1788845449.538412:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180133120 00010000:00010000:1.0:1788845449.538454:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7108c3a/0xd8041b54d6df9e65 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752449 expref: 8 pid: 6658 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.538506:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:1.0:1788845449.538516:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180133120:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845449.538531:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845449.538581:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7108c3a/0xd8041b54d6df9e65 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752449 expref: 8 pid: 6658 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.538595:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7108c3a/0xd8041b54d6df9e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752449 expref: 8 pid: 6658 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.538617:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845449.538621:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845449.538629:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.538639:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.538676:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.538690:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5802:1875740189583616:192.168.206.35@tcp:105: 00000100:00100000:1.0:1788845449.538772:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb96ab840 going to sleep for 11 seconds 00010000:00010000:0.0:1788845449.538935:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7108c3a/0xd8041b54d6df9e65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752449 expref: 8 pid: 6658 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845449.538954:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1875740189583488:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845449.538990:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845449.539016:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b200, rc 0) 00000100:00100000:0.0:1788845449.539044:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:10513:x1875740180132992:12345-192.168.206.35@tcp:101:bash.0 Request processed in 5861us (6290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845449.539051:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:1.0:1788845449.542431:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5802:1875740189583616:192.168.206.35@tcp:105: 00010000:00010000:1.0:1788845449.542460:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845449.542516:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180133120:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 4001us (4196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.542527:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:3.0:1788845449.542984:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.546083:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180133376 00000100:00100000:1.0:1788845449.546103:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180133376 00000100:00100000:1.0:1788845449.546202:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:1.0:1788845449.546289:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+33:10513:x1875740180133376:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:1.0:1788845449.547125:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+34:10513:x1875740180133376:12345-192.168.206.35@tcp:35:bash.0 Request processed in 910us (4139us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788845449.547135:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:3.0:1788845449.689772:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.690075:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180133504 00000100:00100000:1.0:1788845449.690084:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180133504 00000100:00100000:1.0:1788845449.690143:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 97 00000100:00100000:1.0:1788845449.690153:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+34:10529:x1875740180133504:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1788845449.690176:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845449.690196:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752457 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.690260:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.690399:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.690412:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845449.690450:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788845449.690454:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845449.690748:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.690778:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752457 expref: 36 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.690820:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752457 expref: 35 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.690828:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:1.0:1788845449.690831:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845449.690833:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09e00, rc 0) 00000100:00100000:1.0:1788845449.690897:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+35:10529:x1875740180133504:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 745us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.690905:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 97 00000100:00100000:2.0:1788845449.698321:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.698683:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180133760 00000100:00100000:1.0:1788845449.698693:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180133760 00000100:00100000:1.0:1788845449.698759:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:1.0:1788845449.698769:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+35:10529:x1875740180133760:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1788845449.698787:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845449.698806:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775245e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.698919:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9e88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.698932:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.698943:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845449.698952:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788845449.699110:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9e81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775245e expref: 38 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.699129:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775245e expref: 37 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.699137:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8eb00) 00010000:00010000:1.0:1788845449.699140:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845449.699143:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09a00, rc 0) 00000100:00100000:1.0:1788845449.699212:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+37:10529:x1875740180133760:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 445us (905us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788845449.699219:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:0.0:1788845449.708069:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845449.708204:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845449.708416:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180134016 00000100:00100000:3.0:1788845449.708434:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180134016 00000100:00100000:3.0:1788845449.708493:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:3.0:1788845449.708503:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+37:10529:x1875740180134016:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1788845449.708525:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845449.708544:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9e96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752465 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.708881:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6df9e9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.708911:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6df9e9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.708922:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6df9e9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845449.708936:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788845449.709079:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9e96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752465 expref: 40 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.709099:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6df9e9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752465 expref: 39 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.709107:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8eb00) 00010000:00010000:3.0:1788845449.709110:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788845449.709113:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a600, rc 0) 00000100:00100000:3.0:1788845449.709233:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+39:10529:x1875740180134016:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 730us (1028us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788845449.709241:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:1.0:1788845449.709499:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180134144 00000100:00100000:1.0:1788845449.709506:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180134144 00000100:00100000:1.0:1788845449.709545:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:1.0:1788845449.709553:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+39:2373:x1875740180134144:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845449.709563:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845449.709577:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9e88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775245e expref: 39 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.709590:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8eb00) 00010000:00010000:1.0:1788845449.709594:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845449.709617:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+38:2373:x1875740180134144:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 65us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.709635:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:2.0:1788845449.720555:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.720711:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180134272 00000100:00100000:1.0:1788845449.720721:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180134272 00000100:00100000:1.0:1788845449.720799:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:1.0:1788845449.720809:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180134272:12345-192.168.206.35@tcp:1:lfs.0 00010000:00010000:1.0:1788845449.721668:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.721695:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.721704:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845449.721708:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845449.721713:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.721753:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.721770:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 6 pid: 6656 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.721787:0:6658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1875740189583744:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845449.722833:0:6658:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb96ab300 going to sleep for 11 seconds 00000100:00100000:2.0:1788845449.736849:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.737284:0:6658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1875740189583744:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845449.737313:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845449.737398:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180134400 00000100:00100000:3.0:1788845449.737406:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180134400 00002000:00100000:3.0:1788845449.737457:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff92aeadfadf80 x1875740180134400/t0(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:555/0 lens 504/0 e 0 to 0 dl 1788845460 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845449.737467:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeadfadf80 with x1875740180134400 ext(0->8) 00010000:00010000:3.0:1788845449.737474:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 7 pid: 6656 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.737512:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 7 pid: 6656 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845449.737520:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92aeadfadf80 00000100:00100000:3.0:1788845449.737557:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:3.0:1788845449.737567:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180134400:12345-192.168.206.35@tcp:4:lfs.0 00000100:00100000:3.0:1788845449.738089:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:704fd1fa-8fb6-403c-867f-b875231088ec+9:2372:x1875740180134400:12345-192.168.206.35@tcp:4:lfs.0 Request processed in 521us (1251us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788845449.738098:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00002000:00100000:3.0:1788845449.738106:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff92aeadfadf80 x1875740180134400/t4294967302(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:555/0 lens 504/448 e 0 to 0 dl 1788845460 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845449.738115:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeadfadf80 with x1875740180134400 ext(0->8) 00010000:00010000:3.0:1788845449.738121:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 9 pid: 6656 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.738134:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 9 pid: 6656 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845449.738141:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92aeadfadf80 00000100:00100000:2.0:1788845449.742169:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845449.742275:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180134528 00000100:00100000:3.0:1788845449.742285:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180134528 00010000:00010000:3.0:1788845449.742325:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 9 pid: 6656 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845449.742437:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:3.0:1788845449.742447:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+9:2372:x1875740180134528:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845449.742461:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788845449.742479:0:8419:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788845449.742481:0:8419:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788845448 00002000:00010000:3.0:1788845449.742483:0:8419:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788845449 00002000:00010000:3.0:1788845449.742484:0:8419:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788845448 00010000:00010000:3.0:1788845449.742488:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 9 pid: 6656 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.742498:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 9 pid: 6656 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.742515:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b84ecea/0xd8041b54d6df9e6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752450 expref: 9 pid: 6656 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.742528:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845449.742531:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845449.742536:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.742542:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.742569:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845449.742613:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+8:2372:x1875740180134528:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 168us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845449.742620:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00010000:00010000:1.0:1788845449.743868:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.743903:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.743932:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.743941:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.743950:0:6658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.743968:0:6658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845449.743973:0:6658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.743982:0:6658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.743998:0:6658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.744007:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e60eb60/0xd8041b54d6df9eab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.744089:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+7:2374:x1875740180134272:12345-192.168.206.35@tcp:1:lfs.0 Request processed in 23280us (23548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.744097:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:0.0:1788845449.750129:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845449.750210:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180134784 00000100:00100000:3.0:1788845449.750220:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180134784 00000100:00100000:3.0:1788845449.750286:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:3.0:1788845449.750295:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+38:10529:x1875740180134784:12345-192.168.206.35@tcp:35:lfs.0 00000004:00010000:3.0:1788845449.750357:0:5820:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6df9e9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752465 expref: 38 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845449.750651:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788845449.750694:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788845449.751038:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788845449.751090:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.751105:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9e57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752442 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.751112:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.751151:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752442 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.751165:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9e57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752442 expref: 42 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845449.751179:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc845180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5820:1875740189583872:192.168.206.35@tcp:104: 00000100:00100000:3.0:1788845449.751277:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae90919240 going to sleep for 11 seconds 00000100:00100000:0.0:1788845449.754019:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845449.754138:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc845180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5820:1875740189583872:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845449.754164:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.754404:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180134912 00000100:00100000:1.0:1788845449.754412:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180134912 00010000:00010000:1.0:1788845449.754448:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9e57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752442 expref: 43 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.754490:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:1.0:1788845449.754498:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+43:2373:x1875740180134912:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845449.754512:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845449.754520:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9e57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752442 expref: 43 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.754531:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752442 expref: 43 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.754550:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9e57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752442 expref: 43 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.754566:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8eb00) 00010000:00010000:1.0:1788845449.754571:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.754579:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.754608:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.754632:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845449.754687:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+42:2373:x1875740180134912:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 189us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.754695:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 51 00010000:00010000:3.0:1788845449.755402:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.755412:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845449.755544:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788845449.755950:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788845449.756074:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc845180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189584000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788845449.756133:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845449.756200:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189584000 00000100:00100000:1.0:1788845449.756206:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189584000 00000100:00080000:2.0:1788845449.756314:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845449.756322:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788845449.756332:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5820:x1875740189584000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788845449.756434:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5820:x1875740189584000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.756441:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845449.756943:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae909196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845449.756983:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc845180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189584000:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788845449.757783:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788845449.757856:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc845180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189584128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788845449.757897:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845449.757996:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88ad0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788845449.758142:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189584128 00000100:00100000:0.0:1788845449.758148:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189584128 00000100:00100000:0.0:1788845449.758194:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845449.758203:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5820:x1875740189584128:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788845449.758446:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5820:x1875740189584128:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 243us (547us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788845449.758453:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845449.758712:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc845180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189584128:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788845449.758822:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788845449.758870:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.758883:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.758890:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.758897:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845449.758902:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.758910:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.758925:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8eb00) 00010000:00010000:2.0:1788845449.758928:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788845449.758941:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.758949:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6df9eb2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788845449.759155:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788845449.759264:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788845449.759276:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 258978913473ns, next at 259978910713ns, rc = 0 00000001:00080000:2.0:1788845449.759294:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788845449.759331:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8eb00) 00010000:00010000:2.0:1788845449.759335:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788845449.759343:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6df9e9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752465 expref: 46 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845449.759480:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+45:10529:x1875740180134784:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 9185us (9363us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788845449.759488:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 26 00000020:00080000:2.0:1788845449.759493:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788845449.764556:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.764810:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180135040 00000100:00100000:1.0:1788845449.764820:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180135040 00000100:00100000:1.0:1788845449.764885:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 100 00000100:00100000:1.0:1788845449.764896:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+45:10529:x1875740180135040:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1788845449.764919:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845449.764940:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9eb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775246c expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.765022:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775246c expref: 46 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.765038:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775246c expref: 46 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.765083:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845449.765086:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845449.765090:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09400, rc 0) 00000100:00100000:1.0:1788845449.765166:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+46:10529:x1875740180135040:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 272us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.765173:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 100 00000100:00100000:0.0:1788845449.768601:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.768785:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180135296 00000100:00100000:1.0:1788845449.768794:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180135296 00000100:00100000:1.0:1788845449.768849:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:1.0:1788845449.768859:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+46:10529:x1875740180135296:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:1.0:1788845449.769179:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+47:10529:x1875740180135296:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 319us (589us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788845449.769186:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:2.0:1788845449.818699:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845449.819522:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180135424 00000100:00100000:3.0:1788845449.819535:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180135424 00000100:00100000:2.0:1788845449.819868:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 101 00000100:00100000:2.0:1788845449.819880:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+47:10539:x1875740180135424:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:2.0:1788845449.819969:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9ec0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.819986:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820000:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820039:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ec7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820048:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820055:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820149:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ece lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820157:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820345:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845449.820413:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820427:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820434:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9ec0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820441:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820448:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845449.820452:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820466:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9ec0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820479:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845449.820482:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845449.820486:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9ec0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820492:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9ec0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820508:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820514:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ec7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820520:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820526:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845449.820529:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820535:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ec7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820542:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae931ba100) 00010000:00010000:2.0:1788845449.820545:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845449.820547:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ec7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820939:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9ec7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820973:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820980:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ece lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820987:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.820992:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845449.821115:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.821124:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ece lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.821134:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:2.0:1788845449.821137:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845449.821139:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ece lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.821145:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9ece lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845449.821315:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+47:10539:x1875740180135424:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 1433us (2624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845449.821323:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 101 00000100:00100000:0.0:1788845449.854468:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845449.856720:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180135680 00000100:00100000:3.0:1788845449.857347:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180135680 00000100:00100000:3.0:1788845449.857466:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 102 00000100:00100000:3.0:1788845449.857476:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+47:10542:x1875740180135680:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1788845449.857513:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845449.857532:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9ed5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752473 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857602:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9edc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857615:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9edc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857638:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9edc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857652:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9ee3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857659:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857666:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857792:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9eea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857802:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857809:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845449.857818:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788845449.857924:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9edc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857932:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9edc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857940:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9edc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857946:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845449.857950:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9edc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857969:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9edc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.857980:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:3.0:1788845449.857983:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845449.857987:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9edc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.858062:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9edc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.858081:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.858087:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.858094:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.858099:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748aa00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845449.858108:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.858115:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.858124:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae90a6f700) 00010000:00010000:3.0:1788845449.858126:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845449.858129:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9ee3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.858134:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9ee3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.858344:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9ed5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752473 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.858411:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752473 expref: 49 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.858420:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:3.0:1788845449.858422:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845449.858425:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b000, rc 0) 00000100:00100000:3.0:1788845449.858502:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+49:10542:x1875740180135680:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1027us (4046us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788845449.858509:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 102 00000100:00100000:0.0:1788845449.864240:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.864390:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180135808 00000100:00100000:1.0:1788845449.864400:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180135808 00000100:00100000:1.0:1788845449.864501:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00100000:1.0:1788845449.864512:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+49:10542:x1875740180135808:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:1.0:1788845449.864580:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9ef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.864596:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.864607:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.864661:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.864668:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.864674:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.864680:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845449.864684:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.864692:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.864704:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845449.864707:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845449.864710:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9ef8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.864717:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9ef8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.864791:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+49:10542:x1875740180135808:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 279us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.864799:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00100000:0.0:1788845449.869484:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845449.869811:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180136064 00000100:00100000:2.0:1788845449.869820:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180136064 00000100:00100000:2.0:1788845449.869877:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:2.0:1788845449.869886:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+49:10542:x1875740180136064:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:2.0:1788845449.870148:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+50:10542:x1875740180136064:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 263us (676us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788845449.870155:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:0.0:1788845449.956107:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845449.956223:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180136320 00000100:00100000:2.0:1788845449.956233:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180136320 00000100:00100000:2.0:1788845449.956295:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 104 00000100:00100000:2.0:1788845449.956305:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+50:10552:x1875740180136320:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1788845449.956329:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845449.956332:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788845449.956356:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09e00/0xd8041b54d6df9e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752457 expref: 50 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.956422:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845449.956426:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845449.956445:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9eff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775247a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.956539:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.956552:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9eea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752473 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.956559:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.956612:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752473 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.956624:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752473 expref: 50 pid: 5817 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845449.956639:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadfad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875740189584256:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845449.956719:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845449.962155:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845449.962265:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadfad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875740189584256:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845449.962294:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.962408:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180136448 00000100:00100000:1.0:1788845449.962415:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180136448 00010000:00010000:1.0:1788845449.962464:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752473 expref: 51 pid: 5817 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.962521:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:1.0:1788845449.962530:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+51:2373:x1875740180136448:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845449.962544:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845449.962551:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752473 expref: 51 pid: 5817 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.962562:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752473 expref: 51 pid: 5817 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.962583:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6df9eea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752473 expref: 51 pid: 5817 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.962597:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845449.962602:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.962610:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.962617:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.962637:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845449.962679:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+50:2373:x1875740180136448:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 150us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.962686:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 52 00010000:00010000:2.0:1788845449.962749:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.962756:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845449.962773:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788845449.962928:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9eff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775247a expref: 51 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.962943:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775247a expref: 50 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.962950:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:2.0:1788845449.962953:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788845449.962971:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1000, rc 0) 00000100:00100000:2.0:1788845449.962999:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+50:10552:x1875740180136320:12345-192.168.206.35@tcp:101:bash.0 Request processed in 6697us (6907us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788845449.963008:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 104 00000100:00100000:0.0:1788845449.966560:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.966651:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180136704 00000100:00100000:1.0:1788845449.966676:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180136704 00000100:00100000:1.0:1788845449.966926:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 105 00000100:00100000:1.0:1788845449.966936:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+50:10552:x1875740180136704:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:1.0:1788845449.967334:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9f14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.967351:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.967393:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788845449.967453:0:8176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788845449.967478:0:8176:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bb4dcce reply state 00000000e36ef1d7 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.967488:0:8176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788845449.967565:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+53:10552:x1875740180136704:12345-192.168.206.35@tcp:36:bash.0 Request processed in 630us (1018us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788845449.967572:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 105 00000020:00080000:1.0:1788845449.967577:0:8176:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788845449.969979:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.969998:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9f14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.970023:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9f14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.970030:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845449.970035:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9f14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.970042:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9f14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.970057:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:3.0:1788845449.970060:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845449.970064:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9f14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845449.970070:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09600/0xd8041b54d6df9f14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845449.972434:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845449.972534:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180136832 00000100:00100000:1.0:1788845449.972545:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180136832 00000100:00100000:1.0:1788845449.972601:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 106 00000100:00100000:1.0:1788845449.972612:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+52:10552:x1875740180136832:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1788845449.972641:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845449.972662:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9f1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752481 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.972764:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.972797:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775247a expref: 53 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.972807:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.972841:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775247a expref: 53 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.972868:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775247a expref: 53 pid: 5819 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.972882:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189584384:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845449.972980:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb96ab6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845449.978124:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845449.978505:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180136960 00000100:00100000:2.0:1788845449.978516:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180136960 00010000:00010000:2.0:1788845449.978558:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775247a expref: 54 pid: 5819 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845449.978720:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:2.0:1788845449.978730:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+54:2373:x1875740180136960:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845449.978746:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845449.978754:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775247a expref: 54 pid: 5819 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.978767:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775247a expref: 54 pid: 5819 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.978789:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:2.0:1788845449.978795:0:6672:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.978804:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.978811:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845449.978831:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845449.978886:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+54:2373:x1875740180136960:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 158us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845449.978894:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 53 00010000:00010000:1.0:1788845449.978976:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6df9f06 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775247a expref: 53 pid: 5819 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845449.978996:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189584384:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845449.979017:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.979025:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.979031:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845449.979075:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788845449.979091:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845449.979114:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.979145:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9f1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752481 expref: 53 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.979160:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752481 expref: 52 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845449.979166:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845449.979169:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845449.979172:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08400, rc 0) 00000100:00100000:1.0:1788845449.979197:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+52:10552:x1875740180136832:12345-192.168.206.35@tcp:101:bash.0 Request processed in 6588us (6776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845449.979204:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 106 00000100:00100000:0.0:1788845449.983228:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845449.983329:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180137216 00000100:00100000:2.0:1788845449.983339:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180137216 00000100:00100000:2.0:1788845449.983513:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:2.0:1788845449.983524:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+52:10552:x1875740180137216:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:2.0:1788845449.983805:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+53:10552:x1875740180137216:12345-192.168.206.35@tcp:35:bash.0 Request processed in 283us (589us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788845449.983813:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:0.0:1788845450.040582:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845450.040673:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180137344 00000100:00100000:2.0:1788845450.040683:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180137344 00000100:00100000:2.0:1788845450.040753:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 107 00000100:00100000:2.0:1788845450.040763:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+53:10558:x1875740180137344:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845450.040786:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845450.040805:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9f29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752488 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.040868:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9f30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.040881:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.040892:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845450.040928:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788845450.040932:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845450.040980:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.041003:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6df9f29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752488 expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.041025:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9f30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752488 expref: 54 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.041033:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845450.041036:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845450.041039:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0c00, rc 0) 00000100:00100000:2.0:1788845450.042568:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+54:10558:x1875740180137344:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1795us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845450.042580:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 107 00000100:00100000:0.0:1788845450.045606:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845450.046192:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180137472 00000100:00100000:1.0:1788845450.046202:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180137472 00000100:00100000:1.0:1788845450.046263:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 108 00000100:00100000:1.0:1788845450.046274:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+54:10558:x1875740180137472:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1788845450.046293:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845450.046312:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9f37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775248f expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046421:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9f3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046434:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9f3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046465:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9f3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046479:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9f45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046486:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046493:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046577:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9f4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046585:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046591:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845450.046632:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788845450.046636:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845450.046652:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046662:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046671:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9f3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046688:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9f3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046695:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9f3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046701:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845450.046705:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9f3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046712:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9f3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046723:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:1.0:1788845450.046726:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845450.046739:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9f3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046745:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6df9f3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046759:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046765:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9f45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046771:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9f45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046776:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845450.046783:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9f45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046790:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9f45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046796:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae93b8e900) 00010000:00010000:1.0:1788845450.046798:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845450.046801:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9f45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046806:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9f45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046832:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9f37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775248f expref: 56 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046844:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775248f expref: 55 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.046851:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845450.046853:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845450.046855:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09200, rc 0) 00000100:00100000:1.0:1788845450.046902:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+55:10558:x1875740180137472:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 631us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845450.046908:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 108 00000100:00100000:0.0:1788845450.050480:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845450.050619:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180137600 00000100:00100000:1.0:1788845450.050630:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180137600 00000100:00100000:1.0:1788845450.050779:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:1.0:1788845450.050791:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+55:2375:x1875740180137600:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845450.050826:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845450.050848:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9f4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775248f expref: 55 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.050868:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845450.050872:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845450.050926:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+54:2375:x1875740180137600:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 138us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845450.050933:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:0.0:1788845450.052296:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845450.052841:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180137856 00000100:00100000:2.0:1788845450.052854:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180137856 00000100:00100000:2.0:1788845450.052910:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 109 00000100:00100000:2.0:1788845450.052920:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+54:10558:x1875740180137856:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845450.052937:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845450.052972:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9f53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752496 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.053073:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.053098:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752481 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.053129:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.053163:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752481 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.053177:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752481 expref: 55 pid: 5818 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845450.053190:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadfad180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189584512:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845450.053275:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845450.056812:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadfad180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189584512:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845450.056843:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845450.057118:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845450.057463:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180137984 00000100:00100000:3.0:1788845450.057472:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180137984 00010000:00010000:3.0:1788845450.057511:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752481 expref: 56 pid: 5818 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845450.057589:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:3.0:1788845450.057600:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+56:2372:x1875740180137984:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845450.057625:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845450.057632:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752481 expref: 56 pid: 5818 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.057663:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752481 expref: 56 pid: 5818 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.057684:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6df9f22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752481 expref: 56 pid: 5818 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.057700:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:3.0:1788845450.057704:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.057713:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.057720:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.057754:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845450.057803:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+55:2372:x1875740180137984:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 205us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845450.057810:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 54 00010000:00010000:1.0:1788845450.058225:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.058234:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845450.058253:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788845450.058451:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6df9f53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752496 expref: 56 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.058467:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752496 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.058474:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845450.058477:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788845450.058489:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1800, rc 0) 00000100:00100000:1.0:1788845450.058520:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+55:10558:x1875740180137856:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 5602us (6232us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788845450.058527:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 109 00000100:00100000:2.0:1788845450.062160:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845450.062254:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180138240 00000100:00100000:3.0:1788845450.062263:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180138240 00000100:00100000:3.0:1788845450.062920:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:3.0:1788845450.062939:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+55:10558:x1875740180138240:12345-192.168.206.35@tcp:103:lfs.0 00010000:00010000:3.0:1788845450.062966:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845450.062990:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6df9eb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775246c expref: 55 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.063032:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:3.0:1788845450.063037:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845450.063096:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+54:10558:x1875740180138240:12345-192.168.206.35@tcp:103:lfs.0 Request processed in 165us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845450.063104:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:0.0:1788845450.070184:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845450.074028:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180138368 00000100:00100000:3.0:1788845450.074045:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180138368 00000100:00100000:3.0:1788845450.074128:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 110 00000100:00100000:3.0:1788845450.074138:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+54:10558:x1875740180138368:12345-192.168.206.35@tcp:58:lfs.0 00010000:00010000:3.0:1788845450.074268:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.074286:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.074298:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788845450.074525:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788845450.074685:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+54:10558:x1875740180138368:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 547us (4513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845450.074694:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 110 00010000:00010000:3.0:1788845450.075746:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845450.078140:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845450.078195:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180138496 00000100:00100000:3.0:1788845450.078205:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180138496 00000100:00100000:3.0:1788845450.078269:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 111 00000100:00100000:3.0:1788845450.078288:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+54:10558:x1875740180138496:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1788845450.078326:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845450.078347:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9f6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775249d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.078444:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.078455:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9f6f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775249d expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.078591:0:5817:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.078606:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9f6f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775249d expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.078629:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:3.0:1788845450.078632:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845450.078636:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9f6f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775249d expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.078645:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748aa00, rc 0) 00000100:00100000:2.0:1788845450.078903:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+55:10558:x1875740180138496:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 624us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845450.078911:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 111 00000001:00080000:2.0:1788845450.885231:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788845450.885257:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:1.0:1788845450.908287:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845450.908299:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788845450.908338:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788845450.908344:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788845450.908527:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189584640:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788845450.909391:0:11641:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845450.915011:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845450.915151:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189584640:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788845450.915463:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180138624 00000100:00100000:2.0:1788845450.915471:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180138624 00000100:00100000:2.0:1788845450.915531:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 112 00000100:00100000:2.0:1788845450.915541:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+55:10559:x1875740180138624:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788845450.915570:0:5818:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788845450.915886:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+55:10559:x1875740180138624:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 346us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845450.915914:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 112 00000100:00100000:2.0:1788845450.920436:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845450.920566:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180138752 00000100:00100000:3.0:1788845450.920576:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180138752 00000100:00100000:3.0:1788845450.920891:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 113 00000100:00100000:3.0:1788845450.921167:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+55:10559:x1875740180138752:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788845450.921238:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9f76 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921276:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9f76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921289:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9f76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921305:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9f7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921312:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9f7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921318:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9f7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921342:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9f84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921349:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921355:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845450.921418:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788845450.921423:0:7234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845450.921436:0:7234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921446:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9f76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921462:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9f76 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921468:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9f76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921473:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845450.921477:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9f76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921483:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9f76 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921493:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:3.0:1788845450.921496:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845450.921499:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9f76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921504:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9f76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921520:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9f7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921525:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9f7d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921531:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9f7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921535:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845450.921544:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9f7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921549:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9f7d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921557:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff92ae90a6f700) 00010000:00010000:3.0:1788845450.921559:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845450.921562:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9f7d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921568:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9f7d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921593:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921600:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9f84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921606:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9f84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921922:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ac00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845450.921929:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9f84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921936:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9f84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921945:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:3.0:1788845450.921947:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845450.921966:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9f84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.921972:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9f84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845450.922054:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+55:10559:x1875740180138752:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 Request processed in 894us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845450.922062:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 113 00000100:00100000:0.0:1788845450.924981:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845450.925077:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180139008 00000100:00100000:2.0:1788845450.925502:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180139008 00000100:00100000:2.0:1788845450.926202:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00100000:2.0:1788845450.926216:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+55:10559:x1875740180139008:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845450.926234:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845450.926254:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9f8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524a4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.926348:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9f92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.926396:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.926408:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845450.926419:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788845450.926525:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.926533:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9f92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.926539:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9f92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.926545:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0a00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845450.926568:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9f92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.926576:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9f92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.927351:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:2.0:1788845450.927357:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788845450.927455:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9f92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.927464:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9f92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.927514:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9f8b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524a4 expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.927526:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:2.0:1788845450.927528:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845450.927532:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9f8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524a4 expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.927541:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1600, rc 0) 00000100:00100000:2.0:1788845450.927883:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+56:10559:x1875740180139008:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 1670us (2913us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788845450.927892:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00100000:0.0:1788845450.931132:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845450.932012:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180139136 00000100:00100000:2.0:1788845450.932024:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180139136 00000100:00100000:2.0:1788845450.932289:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 115 00000100:00100000:2.0:1788845450.932301:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+56:10559:x1875740180139136:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788845450.932354:0:5818:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788845450.932484:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+56:10559:x1875740180139136:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 185us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845450.932491:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 115 00000100:00100000:0.0:1788845450.937971:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845450.938263:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180139392 00000100:00100000:3.0:1788845450.938273:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180139392 00000100:00100000:3.0:1788845450.938337:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:3.0:1788845450.938346:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+56:10559:x1875740180139392:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845450.938383:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845450.938386:0:7234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788845450.938411:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6df9f30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752488 expref: 56 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.938432:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:3.0:1788845450.938437:0:7234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845450.938449:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9fa0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524ab expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788845450.939234:0:7234:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788845450.939534:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9fa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.939549:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.939573:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.939631:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9fa0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ab expref: 58 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.939650:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ab expref: 57 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.939657:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae90a6f700) 00010000:00010000:3.0:1788845450.939660:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845450.939663:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a800, rc 0) 00000100:00100000:3.0:1788845450.942213:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+57:10559:x1875740180139392:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 3855us (4259us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788845450.942227:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:0.0:1788845450.947335:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845450.947559:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180139648 00000100:00100000:2.0:1788845450.947570:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180139648 00000100:00100000:2.0:1788845450.947631:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 117 00000100:00100000:2.0:1788845450.947641:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+57:10559:x1875740180139648:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788845450.947697:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845450.947723:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6df9fa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ab expref: 57 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947742:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae90a6f700) 00010000:00010000:2.0:1788845450.947752:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845450.947771:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9fb5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947784:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947793:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947807:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9fbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x63975579 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947813:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9fbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x63975579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947840:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9fbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x63975579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947908:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947915:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9fb5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947921:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9fb5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947927:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845450.947932:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9fb5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947939:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9fb5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947948:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845450.947960:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845450.947964:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9fb5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947969:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6df9fb5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947979:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9fbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x63975579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947985:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9fbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x63975579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.947997:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9fbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x63975579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.948001:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0a00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845450.948004:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9fbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x63975579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.948009:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9fbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x63975579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.948017:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x63975579 (ffff92ae931baf00) 00010000:00010000:2.0:1788845450.948019:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845450.948021:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9fbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x63975579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.948026:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6df9fbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x63975579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845450.948114:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+56:10559:x1875740180139648:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 474us (792us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788845450.948122:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 117 00000100:00100000:0.0:1788845450.952875:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845450.953013:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180139776 00000100:00100000:1.0:1788845450.953106:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180139776 00000100:00100000:1.0:1788845450.953228:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 118 00000100:00100000:1.0:1788845450.953238:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+56:10559:x1875740180139776:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845450.953257:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845450.953278:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9fc3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524b2 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.953312:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9fca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.953324:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.953335:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.953564:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6df9fc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524b2 expref: 58 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.953592:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524b2 expref: 57 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.953601:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:1.0:1788845450.953604:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788845450.953606:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09a00, rc 0) 00000100:00100000:1.0:1788845450.953875:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+57:10559:x1875740180139776:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 638us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845450.953884:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 118 00000100:00100000:3.0:1788845450.957942:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845450.958199:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180140032 00000100:00100000:2.0:1788845450.958210:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180140032 00000100:00100000:2.0:1788845450.958279:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 119 00000100:00100000:2.0:1788845450.958289:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+57:10559:x1875740180140032:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788845450.958402:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9fd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.958419:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.958448:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788845450.958711:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788845450.958722:0:7234:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 260178358651ns, next at 261178355918ns, rc = 0 00000004:00010000:2.0:1788845450.958816:0:7234:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa5d0da9 reply state 000000000b3460dc transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845450.958825:0:7234:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845450.958933:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+59:10559:x1875740180140032:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 645us (1003us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788845450.958940:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 119 00010000:00010000:2.0:1788845450.962138:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.962223:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9fd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.962230:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.962236:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845450.962241:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.962248:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9fd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.962263:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:2.0:1788845450.962266:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788845450.962290:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9fd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.962296:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6df9fd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845450.962827:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845450.963548:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180140160 00000100:00100000:2.0:1788845450.963560:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180140160 00000100:00100000:1.0:1788845450.963702:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 120 00000100:00100000:1.0:1788845450.963715:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+58:10559:x1875740180140160:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845450.963738:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845450.963755:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9fd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.963813:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524b9 expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.963828:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524b9 expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.963857:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:1.0:1788845450.963861:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845450.963864:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09c00, rc 0) 00000100:00100000:1.0:1788845450.963924:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+59:10559:x1875740180140160:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 212us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845450.963957:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 120 00000100:00100000:2.0:1788845450.968031:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845450.968186:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180140288 00000100:00100000:0.0:1788845450.968196:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180140288 00000100:00100000:0.0:1788845450.968285:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:0.0:1788845450.968297:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180140288:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788845450.968988:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+9:2373:x1875740180140288:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 690us (968us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788845450.968997:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:0.0:1788845450.972249:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845450.972300:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845450.972398:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845450.972445:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845450.972571:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180140672 00000100:00100000:1.0:1788845450.972578:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180140544 00000100:00100000:3.0:1788845450.972581:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180140672 00000100:00100000:1.0:1788845450.972581:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180140544 00000100:00100000:3.0:1788845450.972643:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 107 00000100:00100000:3.0:1788845450.972654:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180140672:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845450.972715:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180140416 00000100:00100000:3.0:1788845450.972746:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180140672:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 95us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845450.972754:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 107 00000100:00100000:1.0:1788845450.972819:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:1.0:1788845450.972827:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180140544:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845450.972857:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180140544:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 32us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845450.972864:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:1.0:1788845450.972882:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180140928 00000100:00100000:1.0:1788845450.972886:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180140928 00000100:00100000:1.0:1788845450.972919:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:1.0:1788845450.972926:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+59:10559:x1875740180140928:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788845450.973140:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+60:10559:x1875740180140928:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 214us (695us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788845450.973148:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:2.0:1788845450.973208:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180140416 00000100:00100000:2.0:1788845450.973240:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 275 00000100:00100000:2.0:1788845450.973248:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180140416:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845450.973275:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180140416:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 29us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845450.973281:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 275 00000100:00080000:2.0:1788845450.973309:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845450.975918:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845450.976030:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180141184 00000100:00100000:2.0:1788845450.976044:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180141184 00000100:00100000:2.0:1788845450.976117:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 121 00000100:00100000:2.0:1788845450.976126:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+60:10559:x1875740180141184:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788845450.976306:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+60:10559:x1875740180141184:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 179us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845450.976313:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 121 00000100:00100000:2.0:1788845450.980238:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845450.980452:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180141312 00000100:00100000:3.0:1788845450.980480:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180141312 00000100:00100000:3.0:1788845450.980542:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:3.0:1788845450.980562:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+60:10559:x1875740180141312:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845450.980582:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845450.980601:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9fdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524c0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.980679:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9fe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.980702:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.980712:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845450.980760:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845450.980779:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.980805:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6df9fdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524c0 expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.980823:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524c0 expref: 61 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845450.980831:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:3.0:1788845450.980834:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788845450.980837:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a200, rc 0) 00000100:00100000:3.0:1788845450.980912:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+61:10559:x1875740180141312:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 361us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845450.980926:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:1.0:1788845450.985188:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845450.985351:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180141440 00000100:00100000:3.0:1788845450.985396:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180141440 00000100:00100000:2.0:1788845450.986132:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:2.0:1788845450.986145:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+9:2373:x1875740180141440:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845450.986161:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845450.986198:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeacad81/0xd8041b54d6df9fed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524c7 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845450.986227:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9d8a, blocks: 0x1 00010000:00010000:2.0:1788845450.986245:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=260s v=(0 0) 00010000:00010000:2.0:1788845450.986249:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845450.986258:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeacad81/0xd8041b54d6df9fed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524c7 expref: 10 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.986277:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aeacad81/0xd8041b54d6df9fed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524c7 expref: 10 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845450.986292:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1400, rc 0) 00000100:00100000:2.0:1788845450.986350:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+10:2373:x1875740180141440:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 208us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845450.986358:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:0.0:1788845450.991320:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845450.991575:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180141696 00000100:00100000:3.0:1788845450.991586:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180141696 00000100:00100000:3.0:1788845450.991689:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 123 00000100:00100000:3.0:1788845450.991699:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+61:10559:x1875740180141696:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788845450.991823:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+61:10559:x1875740180141696:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 125us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845450.991830:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 123 00000100:00100000:0.0:1788845450.993889:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845450.994000:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180141824 00000100:00100000:1.0:1788845450.994009:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180141824 00000100:00100000:1.0:1788845450.994065:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:1.0:1788845450.994075:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+10:10559:x1875740180141824:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845450.994153:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845450.994292:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524ce expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.994327:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aeacad81/0xd8041b54d6df9fed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524c7 expref: 11 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.994336:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845450.994340:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845450.994344:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.994529:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aeacad81/0xd8041b54d6df9fed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524c7 expref: 11 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.994544:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aeacad81/0xd8041b54d6df9fed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524c7 expref: 11 pid: 6656 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845450.994560:0:6658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1875740189584768:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845450.994637:0:6658:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845450.998180:0:6658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1875740189584768:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845450.998219:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845450.998241:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09200, rc 0) 00000100:00100000:1.0:1788845450.998398:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+11:10559:x1875740180141824:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 4288us (4483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845450.998428:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:3.0:1788845450.999582:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845451.000002:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180141952 00000100:00100000:1.0:1788845451.000011:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180141952 00010000:00010000:1.0:1788845451.000048:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aeacad81/0xd8041b54d6df9fed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524c7 expref: 11 pid: 6656 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845451.000092:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:1.0:1788845451.000101:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+11:2373:x1875740180141952:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845451.000113:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845451.000138:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aeacad81/0xd8041b54d6df9fed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524c7 expref: 11 pid: 6656 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.000151:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aeacad81/0xd8041b54d6df9fed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524c7 expref: 11 pid: 6656 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.000173:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeacad81/0xd8041b54d6df9fed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524c7 expref: 11 pid: 6656 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.000192:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845451.000197:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845451.000204:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 10 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.000214:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 10 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.000273:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 10 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845451.000288:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5802:1875740189584896:192.168.206.35@tcp:105: 00000100:00100000:1.0:1788845451.000386:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318fc00 going to sleep for 10 seconds 00000100:00100000:1.0:1788845451.006186:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae9eac2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5802:1875740189584896:192.168.206.35@tcp:105: 00010000:00010000:1.0:1788845451.006214:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845451.006323:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+10:2373:x1875740180141952:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 6218us (6742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845451.006335:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:2.0:1788845451.009023:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845451.009158:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180142080 00000100:00100000:0.0:1788845451.009167:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180142080 00002000:00100000:0.0:1788845451.009223:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff92aeadfad180 x1875740180142080/t0(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:557/0 lens 504/0 e 0 to 0 dl 1788845462 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788845451.009257:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeadfad180 with x1875740180142080 ext(0->12) 00002000:00010000:0.0:1788845451.009263:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeadfad180 00000100:00100000:0.0:1788845451.009296:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:0.0:1788845451.009304:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:704fd1fa-8fb6-403c-867f-b875231088ec+10:2374:x1875740180142080:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788845451.009984:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:704fd1fa-8fb6-403c-867f-b875231088ec+12:2374:x1875740180142080:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 Request processed in 678us (977us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788845451.009994:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00002000:00100000:0.0:1788845451.010001:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff92aeadfad180 x1875740180142080/t4294967308(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:557/0 lens 504/448 e 0 to 0 dl 1788845462 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788845451.010010:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeadfad180 with x1875740180142080 ext(0->12) 00002000:00010000:0.0:1788845451.010014:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeadfad180 00000100:00080000:2.0:1788845451.010074:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845451.013774:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845451.014226:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180142208 00000100:00100000:3.0:1788845451.014236:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180142208 00000100:00100000:3.0:1788845451.014356:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 124 00000100:00100000:3.0:1788845451.014414:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+61:10559:x1875740180142208:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 00000100:00080000:2.0:1788845451.014805:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788845451.060556:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967370 is committed 00000020:00080000:0.0:1788845451.060590:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92aeb3c99b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788845451.060596:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ae9eae0300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ae93394840 00000020:00080000:0.0:1788845451.060600:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ae9eae0800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92aeb7573400 00000001:00080000:0.0:1788845451.060633:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788845451.060658:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788845451.060678:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788845451.060689:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788845451.060714:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ae909196c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788845451.060718:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ae8fd8a400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ae90919d80 00000020:00080000:0.0:1788845451.060721:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92aebc964300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92ae90faec00 00000100:00100000:0.0:1788845451.061018:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189585024:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788845451.061166:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845451.061209:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845451.061216:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189585152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788845451.061239:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845451.061268:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845451.061276:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189585280:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788845451.061300:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845451.061330:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189585024 00000100:00100000:0.0:1788845451.061336:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189585024 00000100:00100000:0.0:1788845451.061415:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189585152 00000100:00100000:0.0:1788845451.061419:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189585152 00000100:00100000:0.0:1788845451.061429:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189585280 00000100:00100000:0.0:1788845451.061432:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189585280 00000100:00100000:0.0:1788845451.061448:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788845451.061456:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3283:x1875740189585024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788845451.061480:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788845451.061505:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.061529:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6df9dbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775242d expref: 11 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.061544:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788845451.061549:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845451.061555:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.061583:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6df9dbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.35@tcp remote: 0x461ce1200775242d expref: 11 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.061604:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6df9dbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.35@tcp remote: 0x461ce1200775242d expref: 11 pid: 6656 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845451.061616:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1875740189585408:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845451.061679:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c99f00 going to sleep for 11 seconds 00000100:00080000:0.0:1788845451.061694:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788845451.061697:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1788845451.061773:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788845451.062073:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788845451.062199:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+15:10559:x1875740180142208:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 Request processed in 47787us (48436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845451.062209:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 124 00000100:00100000:2.0:1788845451.065173:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845451.065275:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788845451.065286:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788845451.068337:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1875740189585408:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845451.068399:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845451.068474:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845451.068641:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180142464 00000100:00100000:3.0:1788845451.068648:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180142464 00010000:00010000:3.0:1788845451.068685:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6df9dbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.35@tcp remote: 0x461ce1200775242d expref: 12 pid: 6656 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845451.068966:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:3.0:1788845451.068977:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+12:2373:x1875740180142464:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845451.069010:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845451.069017:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6df9dbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.35@tcp remote: 0x461ce1200775242d expref: 12 pid: 6656 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.069031:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6df9dbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.35@tcp remote: 0x461ce1200775242d expref: 12 pid: 6656 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.069053:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6df9dbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.35@tcp remote: 0x461ce1200775242d expref: 12 pid: 6656 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.069070:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845451.069074:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845451.069080:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.069089:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.069114:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845451.069158:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+11:2373:x1875740180142464:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 183us (684us total) trans 0 rc 0/0 00010000:00010000:2.0:1788845451.069250:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.069274:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.069284:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.069291:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.069306:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788845451.069956:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3283:x1875740189585024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8478us (8768us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788845451.069968:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788845451.069997:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180142336 00000100:00100000:2.0:1788845451.070003:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180142336 00000100:00100000:2.0:1788845451.070036:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788845451.070044:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3283:x1875740189585152:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788845451.070108:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845451.070115:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.070126:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845451.070130:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.070141:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.070156:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845451.070280:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788845451.070285:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788845450 00002000:00010000:2.0:1788845451.070287:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788845451.070290:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788845450 -> 1788845450 00002000:00010000:2.0:1788845451.070292:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788845451.070323:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3283:x1875740189585152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 280us (9083us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788845451.070330:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788845451.070352:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788845451.070360:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189585280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788845451.070398:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1788845451.070425:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f9d88, atime: 0x6a9f9d89, ctime: 0x6a9f9d88, blocks: 0xb 00010000:00010000:2.0:1788845451.070432:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa002 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.070443:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=260s v=(0 0) 00010000:00010000:2.0:1788845451.070447:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845451.070452:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.070466:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.070475:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.070483:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa002 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.070500:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788845451.070688:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 56 00010000:00010000:1.0:1788845451.070850:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3bcc907/0xd8041b54d6df9ffb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.070877:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845451.070882:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa002 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.070890:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0a00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845451.070894:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa002 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.070903:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa002 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.070918:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa002 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.070926:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa002 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.070939:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845451.070941:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845451.070942:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845451.070972:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189585280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 611us (9669us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788845451.070981:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788845451.071000:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:2.0:1788845451.071008:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+11:2372:x1875740180142336:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788845451.071076:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788845451.071284:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92aeb7b7a300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788845451.071292:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189585152:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1788845451.071307:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92aeb7b78a80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788845451.071312:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189585024:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788845451.071546:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788845451.071552:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1788845451.071570:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92aeb7552680, transno 4294967301 00000004:00080000:3.0:1788845451.071581:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1788845451.071598:0:3286:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff92aeb7b7ad80 x1875740189585280/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788845467 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788845451.071608:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92aeb7b7ad80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788845451.071623:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189585280:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788845451.099643:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788845451.106905:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1788845451.107083:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:2.0:1788845451.107263:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180142336:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 Request processed in 36249us (42095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845451.107275:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:1.0:1788845451.110301:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845451.110393:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180142720 00000100:00100000:3.0:1788845451.110404:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180142720 00000100:00100000:3.0:1788845451.110462:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 125 00000100:00100000:3.0:1788845451.110473:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+15:10559:x1875740180142720:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788845451.110528:0:8176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845451.110557:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6df9fe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524c0 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.110579:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:3.0:1788845451.110583:0:8176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845451.110613:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa009 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.110638:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.110647:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845451.110926:0:8176:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002207f374 reply state 00000000c66faac0 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845451.110965:0:8176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845451.111123:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+16:10559:x1875740180142720:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 651us (836us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788845451.111131:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 125 00000100:00100000:3.0:1788845451.113997:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:0.0:1788845451.114006:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.114020:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa009 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.114028:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa009 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.114034:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ac00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845451.114040:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa009 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.114047:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa009 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.114063:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:0.0:1788845451.114082:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845451.114088:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa009 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.114095:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa009 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845451.114186:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180142848 00000100:00100000:1.0:1788845451.114203:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180142848 00000100:00100000:1.0:1788845451.114256:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:1.0:1788845451.114266:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180142848:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788845451.114554:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788845451.114558:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788845450 -> 1788845449 00002000:00010000:1.0:1788845451.114561:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788845449 00002000:00010000:1.0:1788845451.114564:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788845450 -> 1788845449 00002000:00010000:1.0:1788845451.114566:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788845451.114635:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180142848:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 370us (651us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788845451.114643:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:3.0:1788845451.117098:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845451.118085:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180143104 00000100:00100000:0.0:1788845451.118098:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180143104 00000100:00100000:0.0:1788845451.118202:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 126 00000100:00100000:0.0:1788845451.118214:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+15:10559:x1875740180143104:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788845451.118281:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.118298:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9fca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524b2 expref: 15 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.118308:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.118344:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b2 expref: 15 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.118357:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9fca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b2 expref: 15 pid: 8176 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845451.118387:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b79880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189585536:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845451.118479:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae909190c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845451.121904:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845451.122399:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180143232 00000100:00100000:3.0:1788845451.122408:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180143232 00010000:00010000:3.0:1788845451.122449:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9fca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b2 expref: 16 pid: 8176 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845451.122494:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:3.0:1788845451.122504:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+16:2372:x1875740180143232:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845451.122517:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845451.122524:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9fca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b2 expref: 16 pid: 8176 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.122538:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9fca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b2 expref: 16 pid: 8176 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.122560:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:3.0:1788845451.122565:0:6672:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.122574:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.122607:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.122636:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845451.122684:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+16:2372:x1875740180143232:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 181us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845451.122692:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 57 00010000:00010000:0.0:1788845451.122868:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6df9fca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b2 expref: 15 pid: 8176 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845451.122895:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b79880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189585536:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845451.122917:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.122926:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.122933:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.122976:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.122984:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.122991:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.122997:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845451.123002:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.123009:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.123020:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:0.0:1788845451.123022:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788845451.123026:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.123038:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa010 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845451.123092:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+14:10559:x1875740180143104:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 Request processed in 4881us (6006us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788845451.123100:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 126 00000100:00100000:2.0:1788845451.125532:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845451.125629:0:12028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180143360 00000100:00100000:1.0:1788845451.125639:0:12028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180143360 00000100:00100000:1.0:1788845451.125741:0:12028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:1.0:1788845451.125751:0:12028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+7:2374:x1875740180143360:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788845451.125795:0:12028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.125817:0:12028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.125826:0:12028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845451.125830:0:12028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845451.125835:0:12028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.125869:0:12028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.125902:0:12028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 7 pid: 6658 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845451.125917:0:12028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc787100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12028:1875740189585664:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845451.126009:0:12028:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845451.127805:0:12028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc787100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12028:1875740189585664:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845451.127833:0:12028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845451.129237:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845451.129321:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180143488 00000100:00100000:1.0:1788845451.129329:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180143488 00010000:00010000:1.0:1788845451.129392:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 8 pid: 6658 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845451.129433:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:1.0:1788845451.129442:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180143488:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845451.129457:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845451.129481:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 8 pid: 6658 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.129493:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 8 pid: 6658 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.129515:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ec9701e/0xd8041b54d6df9ff4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0x461ce120077524ce expref: 8 pid: 6658 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.129534:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845451.129538:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845451.129561:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.129570:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.129603:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845451.129663:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180143488:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 221us (434us total) trans 0 rc 0/0 00010000:00010000:0.0:1788845451.129670:0:12028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845451.129671:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 58 00010000:00010000:0.0:1788845451.129679:0:12028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.129703:0:12028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.129712:0:12028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.129720:0:12028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.129740:0:12028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845451.129744:0:12028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.129751:0:12028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.129763:0:12028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.129771:0:12028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e4f4ee/0xd8041b54d6dfa017 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845451.129827:0:12028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180143360:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 Request processed in 4077us (4306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845451.129834:0:12028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:2.0:1788845451.131964:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845451.132055:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180143744 00000100:00100000:3.0:1788845451.132064:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180143744 00000100:00100000:3.0:1788845451.132168:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 127 00000100:00100000:3.0:1788845451.132179:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+14:10559:x1875740180143744:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788845451.132256:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa01e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.132273:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa01e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.132285:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa01e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.132813:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.132827:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524b9 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.132835:0:7234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.132871:0:7234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b9 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.132885:0:7234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b9 expref: 15 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845451.132923:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7be5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189585792:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845451.133062:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845451.135343:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7be5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189585792:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845451.135407:0:7234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845451.135630:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845451.135672:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180143872 00000100:00100000:1.0:1788845451.135679:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180143872 00010000:00010000:1.0:1788845451.135714:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b9 expref: 16 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845451.135745:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:1.0:1788845451.135758:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+16:2372:x1875740180143872:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845451.135772:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845451.135779:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b9 expref: 16 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.135791:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b9 expref: 16 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.135813:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6df9fd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524b9 expref: 16 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.135829:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:1.0:1788845451.135851:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.135860:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.135867:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.135895:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845451.135961:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+15:2372:x1875740180143872:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 198us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845451.135969:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 59 00010000:00010000:0.0:1788845451.136017:0:7234:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845451.136023:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845451.136243:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788845451.136850:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788845451.136910:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788845451.137008:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b79880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189585920:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788845451.137062:0:7234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845451.137095:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845451.137110:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189585920 00000100:00100000:2.0:1788845451.137116:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189585920 00000100:00100000:2.0:1788845451.137161:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788845451.137169:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7234:x1875740189585920:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788845451.137299:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7234:x1875740189585920:12345-0@lo:1000:mdt00_003.0 Request processed in 130us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845451.137306:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845451.137560:0:7234:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788845451.137566:0:7234:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1788845451.137584:0:7234:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92aeb7b78a80, transno 4294967309 00000004:00080000:0.0:1788845451.137599:0:7234:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92aeb7b7a300, transno 4294967310 00000100:00100000:0.0:1788845451.137606:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b79880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189585920:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788845451.139460:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788845451.139547:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b79880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189586048:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788845451.139611:0:7234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845451.139638:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae909190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845451.139642:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189586048 00000100:00100000:1.0:1788845451.139648:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189586048 00000100:00100000:1.0:1788845451.139699:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788845451.139709:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7234:x1875740189586048:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788845451.139920:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7234:x1875740189586048:12345-0@lo:1000:mdt00_003.0 Request processed in 211us (307us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788845451.139928:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788845451.139992:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b79880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189586048:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788845451.140027:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140037:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140044:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140068:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845451.140073:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140081:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140096:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae93b8ef00) 00010000:00010000:1.0:1788845451.140099:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845451.140102:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140109:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa025 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140138:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140144:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140150:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140154:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845451.140157:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140163:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140182:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845451.140185:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845451.140192:0:7234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9f6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775249d expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140202:0:7234:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9f6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775249d expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140210:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775249d expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.140234:0:7234:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775249d expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845451.140246:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc785c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189586176:192.168.206.35@tcp:105: 00000100:00100000:1.0:1788845451.140314:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845451.143775:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc785c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189586176:192.168.206.35@tcp:105: 00010000:00010000:1.0:1788845451.143810:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.143822:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6df9f68 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.143859:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa02c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.143873:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa02c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.143898:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa02c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.143909:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa02c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.143915:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa02c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.143922:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa02c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.143928:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845451.143932:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa02c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.143939:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa02c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845451.144069:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:1.0:1788845451.144120:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845451.144124:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845451.144128:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa02c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.144134:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa02c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.144146:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa01e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.144152:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa01e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.144165:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa01e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.144171:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845451.144174:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa01e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.144180:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa01e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.144190:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845451.144192:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788845451.144194:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa01e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845451.144200:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa01e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845451.144413:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180144000 00000100:00100000:3.0:1788845451.144421:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180144000 00000100:00100000:1.0:1788845451.144635:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+19:10559:x1875740180143744:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 12457us (12691us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788845451.144647:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 127 00000020:00080000:1.0:1788845451.144653:0:7234:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788845451.144760:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:2.0:1788845451.144772:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+18:10558:x1875740180144000:12345-192.168.206.35@tcp:49:lfs.0 00000040:00080000:3.0:1788845451.144832:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788845451.144837:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788845451.144873:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788845451.144880:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788845451.144886:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+18:10558:x1875740180144000:12345-192.168.206.35@tcp:49:lfs.0 Request processed in 116us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845451.144894:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:2.0:1788845451.151603:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845451.151654:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845451.151760:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180144512 00000100:00100000:3.0:1788845451.151770:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180144512 00000100:00100000:3.0:1788845451.151828:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:3.0:1788845451.151859:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+18:10559:x1875740180144512:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788845451.151916:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180144256 00000100:00100000:1.0:1788845451.151922:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180144256 00000100:00100000:1.0:1788845451.152034:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 128 00000100:00100000:1.0:1788845451.152044:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+19:10558:x1875740180144256:12345-192.168.206.35@tcp:58:lfs.0 00000004:00080000:3.0:1788845451.152898:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788845451.153031:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788845451.153088:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa033 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.153107:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.153120:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.153130:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa033 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.153137:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa033 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.153144:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.153843:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788845451.153966:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+21:10559:x1875740180144512:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 2106us (2307us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788845451.153984:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 32 00000020:00080000:2.0:1788845451.153989:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788845451.154238:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845451.154245:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa033 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.154254:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845451.154258:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa033 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.154266:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.154295:0:8418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ae90a6fe00) 00010000:00010000:3.0:1788845451.154298:0:8418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788845451.154303:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa033 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.154309:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa033 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.154328:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845451.154330:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845451.154332:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788845451.154925:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788845451.155018:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+20:10558:x1875740180144256:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 2974us (3426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845451.155040:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 128 00000100:00100000:0.0:1788845451.185934:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845451.186188:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180144640 00000100:00100000:3.0:1788845451.186198:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180144640 00000100:00100000:3.0:1788845451.186263:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 129 00000100:00100000:3.0:1788845451.186273:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+20:10561:x1875740180144640:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1788845451.186297:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845451.186316:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa03a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524d5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.187131:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa041 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.187165:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.187273:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.187291:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa048 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.187299:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.187306:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.188052:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.188068:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752496 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.188076:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.188253:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752496 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.188272:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752496 expref: 21 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845451.188300:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7551880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189586304:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845451.188696:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788845451.190835:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7551880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189586304:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845451.190864:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845451.191977:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845451.193074:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180144896 00000100:00100000:1.0:1788845451.193085:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180144896 00000100:00100000:1.0:1788845451.193396:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:1.0:1788845451.193407:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+22:5611:x1875740180144896:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788845451.194002:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+23:5611:x1875740180144896:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 595us (2029us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788845451.194011:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:2.0:1788845451.198034:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845451.198238:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180145024 00000100:00100000:3.0:1788845451.198248:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180145024 00010000:00010000:3.0:1788845451.198298:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752496 expref: 23 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845451.198409:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:3.0:1788845451.198419:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+23:2372:x1875740180145024:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845451.198433:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845451.198451:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752496 expref: 23 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.198483:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752496 expref: 23 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.198503:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6df9f5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752496 expref: 23 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.198521:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:3.0:1788845451.198526:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.198534:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.198541:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845451.198569:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845451.198831:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+22:2372:x1875740180145024:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 413us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845451.198839:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 60 00010000:00010000:2.0:1788845451.199665:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.199678:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845451.199725:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788845451.199730:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845451.199825:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.199844:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200574:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200582:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa041 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200589:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa041 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200616:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845451.200621:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa041 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200629:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa041 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200643:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:2.0:1788845451.200645:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845451.200649:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa041 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200656:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa041 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200672:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200678:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa048 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200683:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200688:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845451.200691:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200696:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa048 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200716:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ae931ba700) 00010000:00010000:2.0:1788845451.200718:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845451.200721:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa048 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.200727:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa048 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.201084:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a000/0xd8041b54d6dfa03a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524d5 expref: 22 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.201101:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524d5 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845451.201108:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:2.0:1788845451.201111:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845451.201113:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1200, rc 0) 00000100:00100000:2.0:1788845451.201186:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+21:10561:x1875740180144640:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 14915us (15264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845451.201194:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 129 00000100:00100000:0.0:1788845451.355758:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189586432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845451.355836:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845451.355865:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189586816:0@lo:400:kworker.0 00000100:00100000:2.0:1788845451.355979:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189586688:0@lo:400:kworker.0 00000100:00100000:1.0:1788845451.356088:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845451.356144:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845451.356152:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189586944:0@lo:400:kworker.0 00000100:00100000:1.0:1788845451.356197:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845451.356232:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189586816 00000100:00100000:1.0:1788845451.356239:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189586816 00000100:00100000:1.0:1788845451.356294:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189586944 00000100:00100000:1.0:1788845451.356297:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189586944 00000100:00100000:1.0:1788845451.356328:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788845451.356337:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189586816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845451.356463:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189586432 00000100:00100000:2.0:1788845451.356464:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845451.356470:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189586432 00000100:00100000:2.0:1788845451.356493:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845451.356502:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189586560:0@lo:400:kworker.0 00000100:00100000:0.0:1788845451.356509:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788845451.356518:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189586432:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845451.356534:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788845451.356549:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845451.356575:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189586688 00000100:00100000:2.0:1788845451.356581:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189586688 00000100:00100000:0.0:1788845451.356595:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189586432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845451.356615:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788845451.356641:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189586560 00000100:00100000:0.0:1788845451.356645:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189586560 00000100:00100000:0.0:1788845451.356672:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788845451.356686:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189586560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845451.356726:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189586560:12345-0@lo:400:kworker.0 Request processed in 48us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845451.356733:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788845451.356778:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189586560:0@lo:400:kworker.0 00000100:00100000:0.0:1788845451.356811:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189586432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845451.356820:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788845451.356830:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189586944:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788845451.356845:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845451.356992:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788845451.357001:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189586688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845451.357037:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189586816:12345-0@lo:400:kworker.0 Request processed in 701us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845451.357044:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788845451.357050:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189586688:12345-0@lo:400:kworker.0 Request processed in 49us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845451.357060:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788845451.357081:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189586944:12345-0@lo:400:kworker.0 Request processed in 251us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845451.357084:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189586944:0@lo:400:kworker.0 00000100:00100000:2.0:1788845451.357097:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788845451.357111:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189586816:0@lo:400:kworker.0 00000100:00100000:0.0:1788845451.357111:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189586688:0@lo:400:kworker.0 00000100:00100000:2.0:1788845451.872598:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845451.872620:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189587072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845451.872684:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845451.872903:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189587072 00000100:00100000:2.0:1788845451.872910:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189587072 00000100:00100000:2.0:1788845451.872999:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788845451.873009:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875740189587072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845451.873031:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788845451.873083:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875740189587072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845451.873091:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788845451.873172:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189587072:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788845451.910266:0:12066:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788845451.910276:0:12066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788845451.910319:0:12066:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788845451.910324:0:12066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788845452.123804:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788845452.187670:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788845452.187683:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788845452.187757:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788845452.187764:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788845452.187911:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc845f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189587200:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788845452.188067:0:11641:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845452.195662:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845452.195808:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180145152 00000100:00100000:1.0:1788845452.195828:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180145152 00000100:00100000:1.0:1788845452.195891:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 130 00000100:00100000:1.0:1788845452.195901:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+22:10573:x1875740180145152:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788845452.195934:0:7234:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788845452.196053:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+22:10573:x1875740180145152:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 153us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845452.196060:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 130 00000100:00100000:3.0:1788845452.196746:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc845f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189587200:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788845452.201072:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845452.201267:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180145408 00000100:00100000:1.0:1788845452.201276:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180145408 00000100:00100000:1.0:1788845452.201410:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 131 00000100:00100000:1.0:1788845452.201421:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+21:10573:x1875740180145408:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845452.201441:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845452.201461:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa056 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524dc expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845452.201560:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa05d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845452.201574:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845452.201598:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845452.201610:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788845452.201834:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa056 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524dc expref: 24 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845452.201876:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa05d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524dc expref: 23 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845452.201885:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:1.0:1788845452.201888:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845452.201890:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09400, rc 0) 00000100:00100000:1.0:1788845452.202091:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+23:10573:x1875740180145408:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 671us (1030us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788845452.202098:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 131 00000100:00100000:0.0:1788845452.210065:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845452.210109:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845452.210269:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180145664 00000100:00100000:2.0:1788845452.210278:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180145664 00000100:00100000:3.0:1788845452.210422:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180145792 00000100:00100000:3.0:1788845452.210427:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180145792 00000100:00100000:3.0:1788845452.210484:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:3.0:1788845452.210495:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+24:2374:x1875740180145792:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845452.210509:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845452.210531:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa05d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524dc expref: 24 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845452.210548:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:3.0:1788845452.210552:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845452.210597:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+23:2374:x1875740180145792:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 104us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845452.210604:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:2.0:1788845452.211068:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 132 00000100:00100000:2.0:1788845452.211080:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+22:10573:x1875740180145664:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788845452.211145:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa06b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845452.211158:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845452.211168:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845452.211431:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845452.211439:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa06b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845452.211446:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa06b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845452.211462:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845452.211466:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa06b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845452.211473:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa06b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845452.211482:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:2.0:1788845452.211484:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845452.211488:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa06b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845452.211493:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa06b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845452.211620:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+23:10573:x1875740180145664:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 544us (1567us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788845452.211628:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 132 00000040:00080000:3.0:1788845452.212855:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788845452.212862:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788845452.213791:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788845452.213805:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788845452.220222:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845452.221653:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180146048 00000100:00100000:2.0:1788845452.221666:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180146048 00000100:00100000:2.0:1788845452.221785:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:2.0:1788845452.221825:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+23:10573:x1875740180146048:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788845452.222088:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+24:10573:x1875740180146048:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 277us (1876us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788845452.222096:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 34 00010000:00010000:2.0:1788845453.149936:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788845453.504860:0:12118:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845453.504872:0:12118:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788845453.504915:0:12118:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788845453.504920:0:12118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788845453.625671:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845453.625748:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180146304 00000100:00100000:2.0:1788845453.625757:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180146304 00000100:00100000:2.0:1788845453.625840:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 133 00000100:00100000:2.0:1788845453.625850:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+24:10593:x1875740180146304:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845453.625872:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845453.625892:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa072 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.626001:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6dfa079 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.626015:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6dfa079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.626026:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6dfa079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845453.626036:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788845453.626175:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524e3 expref: 27 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.626191:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6dfa079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524e3 expref: 26 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.626211:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:2.0:1788845453.626214:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788845453.626217:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0c00, rc 0) 00000100:00100000:2.0:1788845453.626275:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+26:10593:x1875740180146304:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 426us (614us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788845453.626282:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 133 00000100:00080000:0.0:1788845453.626616:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845453.635037:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845453.635385:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180146432 00000100:00100000:2.0:1788845453.635396:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180146432 00000100:00100000:2.0:1788845453.635452:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 134 00000100:00100000:2.0:1788845453.635461:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+26:10593:x1875740180146432:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:2.0:1788845453.635524:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.635547:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.635561:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.635600:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.635607:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa087 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.635614:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.635620:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845453.635633:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.635640:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa087 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.635652:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:2.0:1788845453.635655:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845453.635659:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa087 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845453.635664:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845453.635741:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+26:10593:x1875740180146432:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 280us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845453.635749:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 134 00000100:00100000:2.0:1788845453.729822:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845453.730000:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180146560 00000100:00100000:1.0:1788845453.730011:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180146560 00000100:00080000:0.0:1788845453.730172:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845453.730262:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:1.0:1788845453.730275:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180146560:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:1.0:1788845453.730292:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845453.730311:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e34faa35/0xd8041b54d6dfa08e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524ea expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788845453.730341:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f9d89, atime: 0x6a9f9d89, ctime: 0x6a9f9d89, blocks: 0xb 00010000:00010000:1.0:1788845453.730390:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=262s v=(0 0) 00010000:00010000:1.0:1788845453.730395:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845453.730405:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e34faa35/0xd8041b54d6dfa08e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ea expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845453.730442:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e34faa35/0xd8041b54d6dfa08e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ea expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845453.730455:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09600, rc 0) 00000100:00100000:1.0:1788845453.730512:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180146560:12345-192.168.206.35@tcp:101:cat.0 Request processed in 241us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845453.730522:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:1.0:1788845453.737068:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845453.737804:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180146688 00000100:00100000:2.0:1788845453.737815:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180146688 00002000:00100000:2.0:1788845453.737870:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff92aebc786a00 x1875740180146688/t0(0) o3->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:559/0 lens 488/0 e 0 to 0 dl 1788845464 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788845453.737882:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aebc786a00 with x1875740180146688 ext(0->4095) 00002000:00010000:2.0:1788845453.737890:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aebc786a00 00000100:00100000:2.0:1788845453.737924:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:2.0:1788845453.737943:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180146688:12345-192.168.206.35@tcp:3:cat.0 00000100:00100000:2.0:1788845453.739198:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180146688:12345-192.168.206.35@tcp:3:cat.0 Request processed in 1256us (2134us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788845453.739210:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00002000:00100000:2.0:1788845453.739303:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff92aebc786a00 x1875740180146688/t0(0) o3->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:559/0 lens 488/4536 e 0 to 0 dl 1788845464 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788845453.739314:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aebc786a00 with x1875740180146688 ext(0->4095) 00002000:00010000:2.0:1788845453.739320:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aebc786a00 00010000:00010000:3.0:1788845454.177614:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845455.195984:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788845455.993444:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:0.0:1788845456.095276:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845456.095319:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845456.095397:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845456.095426:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845456.095445:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180146816 00000100:00100000:1.0:1788845456.095456:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180146816 00000100:00100000:0.0:1788845456.095458:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845456.095485:0:12028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180147200 00000100:00100000:0.0:1788845456.095490:0:12028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180147200 00000100:00100000:1.0:1788845456.095517:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 277 00000100:00100000:1.0:1788845456.095528:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:2372:x1875740180146816:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845456.095536:0:12028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180147072 00000100:00100000:0.0:1788845456.095540:0:12028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180147072 00000100:00100000:0.0:1788845456.095566:0:12028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:0.0:1788845456.095578:0:12028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180147200:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845456.095601:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:2372:x1875740180146816:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 75us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845456.095609:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 277 00000100:00100000:0.0:1788845456.095628:0:12028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180147200:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845456.095636:0:12028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:1.0:1788845456.095722:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:1.0:1788845456.095732:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2372:x1875740180147072:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845456.095760:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2372:x1875740180147072:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845456.095864:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180146944 00000100:00080000:0.0:1788845456.095866:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845456.095870:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180146944 00000100:00080000:0.0:1788845456.095872:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845456.095913:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180147328 00000100:00100000:2.0:1788845456.095917:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180147328 00000100:00100000:2.0:1788845456.095957:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 111 00000100:00100000:2.0:1788845456.095967:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+26:2373:x1875740180146944:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845456.096003:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+26:2373:x1875740180146944:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 39us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845456.096009:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 111 00000100:00100000:2.0:1788845456.096024:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 112 00000100:00100000:2.0:1788845456.096030:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180147328:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845456.096065:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180147328:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845456.096070:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 112 00000100:00080000:2.0:1788845456.096091:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845456.098199:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00010000:00010000:1.0:1788845456.219770:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845456.479950:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189587712:0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.480039:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845456.480112:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788845456.480119:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189587328:0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.480149:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845456.480174:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189587840:0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.480200:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845456.480228:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189587456:0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.480264:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845456.480284:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189587968:0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.480310:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845456.480328:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845456.480333:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189587584:0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.480354:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845456.480417:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189587712 00000100:00100000:0.0:1788845456.480424:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189587712 00000100:00100000:0.0:1788845456.480477:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189587968 00000100:00100000:0.0:1788845456.480480:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189587968 00000100:00100000:0.0:1788845456.480504:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788845456.480513:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189587712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.480563:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189587712:12345-0@lo:400:kworker.0 Request processed in 51us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845456.480570:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788845456.480586:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788845456.480592:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb4e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875740189587968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.480623:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb4e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875740189587968:12345-0@lo:400:kworker.0 Request processed in 32us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845456.480629:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788845456.480762:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189587328 00000100:00100000:0.0:1788845456.480766:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189587328 00000100:00100000:0.0:1788845456.480792:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788845456.480799:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189587328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.480829:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189587328:12345-0@lo:400:kworker.0 Request processed in 30us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845456.480845:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788845456.480869:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189587840 00000100:00100000:0.0:1788845456.480874:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189587840 00000100:00100000:0.0:1788845456.480902:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189587456 00000100:00100000:0.0:1788845456.480906:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189587456 00000100:00100000:0.0:1788845456.480934:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189587584 00000100:00100000:0.0:1788845456.480937:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189587584 00000100:00100000:0.0:1788845456.480951:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788845456.480957:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189587840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.480984:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189587840:12345-0@lo:400:kworker.0 Request processed in 27us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845456.480990:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788845456.480999:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788845456.481004:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189587456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.481023:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189587456:12345-0@lo:400:kworker.0 Request processed in 20us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845456.481029:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788845456.481037:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788845456.481041:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189587584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.481059:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189587584:12345-0@lo:400:kworker.0 Request processed in 18us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845456.481064:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788845456.481087:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845456.481092:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845456.481093:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845456.481136:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189587584:0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.481157:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189587456:0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.481167:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189587968:0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.481195:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189587328:0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.481203:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189587840:0@lo:400:kworker.0 00000100:00100000:0.0:1788845456.481212:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788845456.481216:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92aeb7b7ad80, transno 4294967304 00000100:00100000:0.0:1788845456.481225:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189587712:0@lo:400:kworker.0 00000100:00100000:2.0:1788845456.482230:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845456.482248:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189588096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845456.482306:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845456.482353:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189588096 00000100:00100000:2.0:1788845456.482359:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189588096 00000100:00100000:2.0:1788845456.482440:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788845456.482447:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189588096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845456.482487:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845456.482529:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189588096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845456.482536:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788845456.482582:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189588096:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788845456.520782:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788845456.520796:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788845456.538811:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:0.0:1788845456.538829:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92aeb3c99000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788845456.538834:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ae9eae0d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92aeb3c999c0 00000020:00080000:0.0:1788845456.538837:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ae9eae0200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92aeb7bf5000 00000001:00080000:0.0:1788845456.538857:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:0.0:1788845456.538868:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788845456.538887:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788845456.538899:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788845456.539103:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1788845456.987651:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189588224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845456.987725:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845456.987913:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189588224 00000100:00100000:3.0:1788845456.987929:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189588224 00000100:00100000:3.0:1788845456.987980:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788845456.987997:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189588224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845456.988029:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845456.988068:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189588224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845456.988075:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788845456.988217:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788845456.988223:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788845456.988257:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189588224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845457.101538:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845457.104087:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180147456 00000100:00100000:2.0:1788845457.104105:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180147456 00000100:00100000:2.0:1788845457.104193:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 135 00000100:00100000:2.0:1788845457.104204:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+13:10239:x1875740180147456:12345-192.168.206.35@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788845457.104332:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+13:10239:x1875740180147456:12345-192.168.206.35@tcp:60:lhsmtool_posix.0 Request processed in 130us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845457.104339:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 135 00000100:00100000:0.0:1788845457.106743:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845457.106958:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180147712 00000100:00100000:1.0:1788845457.106968:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180147712 00000100:00100000:1.0:1788845457.107032:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:1.0:1788845457.107043:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+13:10239:x1875740180147712:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788845457.108262:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+14:10239:x1875740180147712:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 1213us (1525us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788845457.108272:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 35 00010000:00010000:2.0:1788845457.244529:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845457.329846:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845457.333228:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180147840 00000100:00100000:0.0:1788845457.333247:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180147840 00000100:00100000:0.0:1788845457.333429:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 136 00000100:00100000:0.0:1788845457.333441:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c53707e2-5013-40b9-a38c-51554aa096c9+5:11045:x1875740180147840:12345-192.168.206.35@tcp:101:lsof.0 00010000:00010000:0.0:1788845457.333460:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845457.333481:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfa095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845457.333554:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845457.333567:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845457.333587:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845457.333621:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788845457.333624:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845457.333662:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845457.333683:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfa095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524f1 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845457.333701:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524f1 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845457.333709:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:0.0:1788845457.333712:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845457.333738:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845457.333792:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c53707e2-5013-40b9-a38c-51554aa096c9+6:11045:x1875740180147840:12345-192.168.206.35@tcp:101:lsof.0 Request processed in 354us (3959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845457.333799:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 136 00010000:00010000:3.0:1788845458.268407:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845459.299447:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788845459.556631:0:12316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:30:57 (1788845457) 00010000:00010000:1.0:1788845460.318103:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845460.440030:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845460.440272:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180148096 00000100:00100000:2.0:1788845460.440282:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180148096 00000100:00100000:2.0:1788845460.440433:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 137 00000100:00100000:2.0:1788845460.440445:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+14:11309:x1875740180148096:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845460.440474:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845460.440493:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa0a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524f8 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.440569:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa0aa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.440583:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa0aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.440631:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa0aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.440646:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa0b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.440654:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.440660:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.440926:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6dfa0b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.440936:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6dfa0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.440943:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6dfa0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845460.440951:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788845460.441041:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa0aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.441048:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa0aa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.441054:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa0aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.441060:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845460.441071:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa0aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.441079:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa0aa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.441090:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ae83de9b00) 00010000:00010000:2.0:1788845460.441094:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845460.441098:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa0aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.441104:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa0aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788845460.441393:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788845460.442036:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.442045:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa0b1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.442049:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.442052:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845460.442055:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.442059:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa0b1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.442066:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff92ae931ba700) 00010000:00010000:2.0:1788845460.442067:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845460.442079:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa0b1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.442083:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa0b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.442796:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa0a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524f8 expref: 17 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.442816:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6dfa0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524f8 expref: 16 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.442824:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:2.0:1788845460.442827:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845460.442830:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1e00, rc 0) 00000100:00100000:2.0:1788845460.442908:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+16:11309:x1875740180148096:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 2457us (2881us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788845460.442916:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 137 00000100:00100000:1.0:1788845460.449229:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845460.449276:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845460.449347:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180148352 00000100:00100000:0.0:1788845460.449358:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180148352 00000100:00100000:2.0:1788845460.449381:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180148224 00000100:00100000:2.0:1788845460.449386:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180148224 00000100:00100000:2.0:1788845460.449457:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:2.0:1788845460.449468:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+17:2375:x1875740180148224:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845460.449484:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788845460.449490:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 138 00000100:00100000:0.0:1788845460.449500:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+17:11309:x1875740180148352:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 00010000:00010000:2.0:1788845460.449509:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6dfa0b8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524f8 expref: 17 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845460.449529:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:2.0:1788845460.449533:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845460.449600:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+16:11309:x1875740180148352:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 Request processed in 102us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845460.449607:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 138 00000100:00100000:2.0:1788845460.450278:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+15:2375:x1875740180148224:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 808us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845460.450287:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:3.0:1788845461.215546:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845461.215604:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845461.215614:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180148480 00000100:00100000:1.0:1788845461.215625:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180148480 00000100:00100000:3.0:1788845461.215641:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845461.215680:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180148736 00000100:00100000:3.0:1788845461.215685:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845461.215688:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180148736 00000100:00100000:1.0:1788845461.215695:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 279 00000100:00100000:1.0:1788845461.215707:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180148480:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845461.215726:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845461.215746:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180148864 00000100:00100000:0.0:1788845461.215753:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180148864 00000100:00100000:2.0:1788845461.215776:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180148992 00000100:00100000:2.0:1788845461.215781:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180148992 00000100:00100000:1.0:1788845461.215800:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180148480:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 95us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845461.215808:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 279 00000100:00100000:2.0:1788845461.215818:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180148608 00000100:00100000:2.0:1788845461.215822:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180148608 00000100:00100000:2.0:1788845461.215850:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:2.0:1788845461.215859:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c53707e2-5013-40b9-a38c-51554aa096c9+6:2373:x1875740180148992:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845461.215868:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:0.0:1788845461.215880:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180148736:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845461.215911:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c53707e2-5013-40b9-a38c-51554aa096c9+6:2373:x1875740180148992:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 53us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845461.215920:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:2.0:1788845461.215942:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 117 00000100:00100000:3.0:1788845461.215983:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:0.0:1788845461.215990:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180148736:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 111us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845461.215999:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180148864:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845461.216003:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00080000:0.0:1788845461.216028:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845461.216031:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845461.216032:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845461.216215:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+15:2373:x1875740180148608:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845461.218795:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180148864:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 2788us (3057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845461.218809:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:2.0:1788845461.218926:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+15:2373:x1875740180148608:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 2714us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845461.218936:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 117 00010000:00010000:0.0:1788845461.339503:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788845461.467671:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788845461.467682:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788845461.468025:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1788845461.468032:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788845461.599988:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189588352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845461.600065:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845461.600142:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189588352 00000100:00100000:1.0:1788845461.600155:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189588352 00000100:00100000:1.0:1788845461.600218:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788845461.600227:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189588352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845461.600265:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845461.600309:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189588352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845461.600329:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788845461.600350:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845461.600403:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189588352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845461.601101:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189588480:0@lo:400:kworker.0 00000100:00100000:0.0:1788845461.601328:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845461.601457:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189588608:0@lo:400:kworker.0 00000100:00100000:0.0:1788845461.601488:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845461.601508:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845461.601514:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189588992:0@lo:400:kworker.0 00000100:00100000:0.0:1788845461.601538:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845461.601726:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189588480 00000100:00100000:1.0:1788845461.601733:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189588480 00000100:00100000:1.0:1788845461.601770:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788845461.601778:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3285:x1875740189588480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845461.601819:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3285:x1875740189588480:12345-0@lo:400:kworker.0 Request processed in 42us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845461.601826:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788845461.602105:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189588480:0@lo:400:kworker.0 00000100:00100000:0.0:1788845461.602129:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189588736:0@lo:400:kworker.0 00000100:00100000:0.0:1788845461.602462:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845461.602495:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845461.602502:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189588864:0@lo:400:kworker.0 00000100:00100000:0.0:1788845461.602528:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845461.602556:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189588608 00000100:00100000:0.0:1788845461.603098:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189588608 00000100:00100000:0.0:1788845461.603141:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189588736 00000100:00100000:1.0:1788845461.603386:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189588864 00000100:00100000:1.0:1788845461.603391:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189588864 00000100:00100000:1.0:1788845461.603429:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788845461.603436:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189588608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845461.603493:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189588608:12345-0@lo:400:kworker.0 Request processed in 56us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845461.603500:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788845461.603516:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788845461.603522:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189588864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845461.603554:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189588864:12345-0@lo:400:kworker.0 Request processed in 32us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845461.603646:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189588736 00000100:00100000:0.0:1788845461.603738:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788845461.603748:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189588736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845461.603784:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189588736:12345-0@lo:400:kworker.0 Request processed in 39us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845461.603789:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788845461.603810:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189588992 00000100:00100000:0.0:1788845461.603813:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189588992 00000100:00100000:0.0:1788845461.603841:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788845461.603847:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189588992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845461.603888:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189588992:12345-0@lo:400:kworker.0 Request processed in 41us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845461.603905:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788845461.604096:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788845461.604114:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845461.604118:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845461.604726:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189588992:0@lo:400:kworker.0 00000100:00100000:0.0:1788845461.604740:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189588608:0@lo:400:kworker.0 00000100:00100000:0.0:1788845461.604780:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189588864:0@lo:400:kworker.0 00000100:00100000:0.0:1788845461.604791:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189588736:0@lo:400:kworker.0 00000020:00080000:2.0:1788845461.662642:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788845461.662684:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788845461.662694:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1788845461.662771:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000001:00080000:2.0:1788845461.662781:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:3.0:1788845462.100675:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.100947:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180149120 00000100:00100000:0.0:1788845462.100957:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180149120 00000100:00100000:0.0:1788845462.101144:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 139 00000100:00100000:0.0:1788845462.101157:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+13:11351:x1875740180149120:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845462.101175:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845462.101194:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa0c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077524ff expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788845462.101260:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788845462.101275:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa0cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101289:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa0cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101301:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa0cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101316:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101336:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101342:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101642:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa0cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101651:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa0cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101658:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa0cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101664:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845462.101668:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa0cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101676:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa0cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101687:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:0.0:1788845462.101690:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845462.101694:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa0cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101700:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa0cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101710:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101722:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101727:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101733:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845462.101736:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101742:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101749:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92ae83de9a00) 00010000:00010000:0.0:1788845462.101752:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845462.101754:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101759:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101792:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa0c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ff expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101802:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:0.0:1788845462.101804:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845462.101807:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa0c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ff expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.101816:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030600, rc 0) 00000100:00100000:0.0:1788845462.101888:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+13:11351:x1875740180149120:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 735us (1228us total) trans 0 rc 301/301 00000100:00100000:0.0:1788845462.101906:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 139 00000100:00100000:1.0:1788845462.110552:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845462.110611:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180149376 00000100:00100000:1.0:1788845462.110621:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180149376 00000100:00100000:1.0:1788845462.110678:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 140 00000100:00100000:1.0:1788845462.110689:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+13:11351:x1875740180149376:12345-192.168.206.35@tcp:36:lfs.0 00010000:00010000:1.0:1788845462.110744:0:7234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845462.110772:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6df9a44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752338 expref: 13 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.110791:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:1.0:1788845462.110797:0:7234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845462.111132:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845462.111150:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadfae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189589120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845462.111203:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845462.111263:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189589120 00000100:00100000:3.0:1788845462.111267:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189589120 00000100:00100000:3.0:1788845462.111300:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788845462.111308:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189589120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845462.111344:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845462.111416:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189589120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845462.111424:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:0.0:1788845462.111494:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.111511:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524f1 expref: 5 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.111520:0:7234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.111546:0:7234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524f1 expref: 5 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.111559:0:7234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524f1 expref: 5 pid: 5818 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845462.111570:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189589248:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845462.111630:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f71780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845462.111662:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadfae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189589120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845462.116354:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.116547:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189589248:192.168.206.35@tcp:104: 00000100:00100000:3.0:1788845462.116567:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180149504 00000100:00100000:3.0:1788845462.116576:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180149504 00010000:00010000:0.0:1788845462.116578:0:7234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.116612:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524f1 expref: 6 pid: 5818 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845462.116656:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:3.0:1788845462.116675:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c53707e2-5013-40b9-a38c-51554aa096c9+6:2372:x1875740180149504:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845462.116689:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845462.116697:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524f1 expref: 6 pid: 5818 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.116710:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524f1 expref: 6 pid: 5818 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.116731:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa09c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077524f1 expref: 6 pid: 5818 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.116749:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:3.0:1788845462.116754:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.116764:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.116783:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.116806:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845462.116813:0:7234:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.116822:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.116851:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa0e2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.116863:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845462.116870:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2372:x1875740180149504:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 204us (527us total) trans 0 rc 0/0 00010000:00010000:1.0:1788845462.116878:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845462.116882:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 61 00000004:00200000:1.0:1788845462.118054:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788845462.118069:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.118088:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.118095:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.118102:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845462.118106:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.118114:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.118127:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9f00) 00010000:00010000:1.0:1788845462.118130:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845462.118135:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.118141:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa0db lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845462.118162:0:7234:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1ed537f reply state 000000006acd32bc transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845462.118170:0:7234:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788845462.118239:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+14:11351:x1875740180149376:12345-192.168.206.35@tcp:36:lfs.0 Request processed in 7550us (7699us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788845462.118247:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 140 00010000:00010000:2.0:1788845462.124630:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.124651:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa0e2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.124671:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa0e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.124678:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845462.124683:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa0e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.124691:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa0e2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.124707:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92ae93b8e900) 00010000:00010000:2.0:1788845462.124710:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845462.124715:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa0e2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.124721:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa0e2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845462.224009:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845462.224123:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180149632 00000100:00100000:2.0:1788845462.224133:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180149632 00000100:00100000:2.0:1788845462.224199:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 141 00000100:00100000:2.0:1788845462.224210:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+13:11359:x1875740180149632:12345-192.168.206.35@tcp:101:lctl.0 00010000:00010000:2.0:1788845462.224233:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845462.224268:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa0e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752506 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.224331:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6dfa0f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.224393:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6dfa0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.224405:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6dfa0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845462.224445:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788845462.224448:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845462.224472:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6dfa0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.224498:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa0e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752506 expref: 15 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.224517:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6dfa0f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752506 expref: 14 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.224526:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae931ba000) 00010000:00010000:2.0:1788845462.224529:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845462.224532:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1e00, rc 0) 00000100:00100000:3.0:1788845462.224804:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+14:11359:x1875740180149632:12345-192.168.206.35@tcp:101:lctl.0 Request processed in 593us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845462.224822:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 141 00000100:00100000:3.0:1788845462.289358:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.289548:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180149760 00000100:00100000:0.0:1788845462.289559:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180149760 00000100:00100000:0.0:1788845462.289646:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 142 00000100:00100000:0.0:1788845462.289658:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+14:11365:x1875740180149760:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1788845462.289709:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845462.289731:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa0f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775250d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.289820:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.289834:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.289845:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.289861:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa105 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.289868:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.289875:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.289995:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfa10c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290004:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfa10c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290011:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfa10c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845462.290042:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788845462.290052:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845462.290075:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfa10c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290087:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290093:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290101:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290107:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845462.290111:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290119:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290131:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae931ba000) 00010000:00010000:0.0:1788845462.290134:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845462.290138:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290145:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa0fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290162:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290168:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa105 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290185:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa105 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290190:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845462.290193:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa105 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290200:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa105 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290208:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92ae83de9a00) 00010000:00010000:0.0:1788845462.290211:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845462.290214:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa105 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290220:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa105 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290253:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa0f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775250d expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290267:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfa10c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775250d expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.290275:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845462.290277:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788845462.290280:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031200, rc 0) 00000100:00100000:0.0:1788845462.290349:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+15:11365:x1875740180149760:12345-192.168.206.35@tcp:101:bash.0 Request processed in 694us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845462.290416:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 142 00000100:00100000:2.0:1788845462.298234:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845462.298411:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180150016 00000100:00100000:1.0:1788845462.298438:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180150016 00000100:00100000:1.0:1788845462.298511:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 143 00000100:00100000:1.0:1788845462.298529:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+15:11365:x1875740180150016:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1788845462.298557:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845462.298579:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa113 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752514 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.298715:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa11a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.298728:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa11a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.298739:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa11a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.298791:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa121 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.298799:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.298806:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845462.300164:0:7234:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788845462.300304:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.300314:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.302986:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.303062:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa11a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.303070:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa11a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.303078:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa11a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.303083:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09a00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845462.303088:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa11a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.303095:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa11a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.303109:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:1.0:1788845462.303112:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845462.303117:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa11a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.303123:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa11a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845462.303142:0:7234:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000595a0b9 reply state 00000000f76d37e9 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845462.303152:0:7234:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788845462.303210:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa113 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752514 expref: 18 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.303226:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752514 expref: 17 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.303233:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:1.0:1788845462.303236:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845462.303239:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08e00, rc 0) 00000100:00100000:1.0:1788845462.303339:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+18:11365:x1875740180150016:12345-192.168.206.35@tcp:101:bash.0 Request processed in 4820us (5118us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788845462.303349:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 143 00010000:00010000:0.0:1788845462.307988:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.308011:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa121 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.308020:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.308026:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845462.308031:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.308039:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa121 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.308056:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae93b8e700) 00010000:00010000:0.0:1788845462.308059:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845462.308063:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa121 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.308069:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa121 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845462.319303:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845462.321084:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180150144 00000100:00100000:3.0:1788845462.321101:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180150144 00000100:00100000:3.0:1788845462.321167:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:3.0:1788845462.321177:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180150144:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1788845462.321195:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845462.321216:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa136 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775251b expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845462.321247:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845462.321267:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788845462.321273:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845462.321282:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775251b expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.321303:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775251b expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.321333:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a200, rc 0) 00000100:00100000:3.0:1788845462.321433:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180150144:12345-192.168.206.35@tcp:101:bash.0 Request processed in 257us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845462.321452:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:3.0:1788845462.334488:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.334724:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180150272 00000100:00100000:0.0:1788845462.334735:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180150272 00000100:00100000:0.0:1788845462.334792:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:0.0:1788845462.334803:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+6:11365:x1875740180150272:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1788845462.334820:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845462.334852:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752522 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.334887:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa136 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775251b expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.334905:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845462.334909:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845462.334914:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.334949:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775251b expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.334961:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa136 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775251b expref: 7 pid: 6658 timeout: 371 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845462.334974:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1875740189589376:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845462.335071:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f71480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845462.337567:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1875740189589376:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845462.337780:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.337802:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030600, rc 0) 00000100:00100000:0.0:1788845462.337861:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:11365:x1875740180150272:12345-192.168.206.35@tcp:101:bash.0 Request processed in 3060us (3385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845462.337898:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:1.0:1788845462.340472:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845462.342541:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180150400 00000100:00100000:3.0:1788845462.342559:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180150400 00010000:00010000:3.0:1788845462.342615:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa136 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775251b expref: 7 pid: 6658 timeout: 371 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845462.342758:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:3.0:1788845462.342769:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180150400:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845462.342783:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845462.342808:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa136 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775251b expref: 7 pid: 6658 timeout: 371 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.342827:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775251b expref: 7 pid: 6658 timeout: 371 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.342850:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa136 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775251b expref: 7 pid: 6658 timeout: 371 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.342868:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845462.342872:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845462.342915:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.342925:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.342965:0:6672:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845462.342981:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadfaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6672:1875740189589504:192.168.206.35@tcp:105: 00000100:00100000:3.0:1788845462.343066:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc93e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788845462.351067:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845462.351259:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180150656 00000100:00100000:2.0:1788845462.351270:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180150656 00000100:00100000:2.0:1788845462.351331:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:2.0:1788845462.351341:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+17:11365:x1875740180150656:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:3.0:1788845462.351711:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadfaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6672:1875740189589504:192.168.206.35@tcp:105: 00010000:00010000:3.0:1788845462.351735:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845462.351793:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180150400:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 9026us (11333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845462.351803:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:2.0:1788845462.352066:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+18:11365:x1875740180150656:12345-192.168.206.35@tcp:35:bash.0 Request processed in 726us (1012us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788845462.352093:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 36 00010000:00010000:3.0:1788845462.364088:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845462.435701:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845462.435827:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180150912 00000100:00100000:3.0:1788845462.435837:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180150912 00000100:00100000:3.0:1788845462.435964:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 144 00000100:00100000:3.0:1788845462.435976:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+18:11375:x1875740180150912:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1788845462.436001:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845462.436020:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752529 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845462.436114:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788845462.436274:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa144 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752529 expref: 20 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.436287:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae931ba000) 00010000:00010000:3.0:1788845462.436290:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788845462.436295:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a200/0xd8041b54d6dfa144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752529 expref: 20 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.436311:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a200, rc 0) 00000100:00100000:3.0:1788845462.436674:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+19:11375:x1875740180150912:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 699us (985us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788845462.436682:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 144 00000100:00100000:1.0:1788845462.441343:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.441462:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180151168 00000100:00100000:0.0:1788845462.441472:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180151168 00000100:00100000:0.0:1788845462.441524:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:0.0:1788845462.441535:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+19:11375:x1875740180151168:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845462.441792:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+20:11375:x1875740180151168:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 257us (461us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788845462.441799:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:1.0:1788845462.536809:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.540978:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180151296 00000100:00100000:0.0:1788845462.540995:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180151296 00000100:00100000:0.0:1788845462.541087:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 145 00000100:00100000:0.0:1788845462.541099:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+20:11381:x1875740180151296:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845462.541125:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845462.541146:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa152 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752530 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.541210:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.541222:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.541232:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845462.541268:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788845462.541291:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845462.541312:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.541337:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa152 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752530 expref: 22 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.541358:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752530 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.541440:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845462.541443:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845462.541446:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030200, rc 0) 00000100:00100000:0.0:1788845462.541522:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+21:11381:x1875740180151296:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 425us (4727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845462.541528:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 145 00000100:00100000:3.0:1788845462.545741:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845462.545845:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180151552 00000100:00100000:1.0:1788845462.545855:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180151552 00000100:00100000:1.0:1788845462.545927:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 146 00000100:00100000:1.0:1788845462.545938:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+21:11381:x1875740180151552:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1788845462.545958:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845462.545977:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6dfa160 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752537 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.546080:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.546094:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.546127:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845462.546139:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788845462.546286:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6dfa160 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752537 expref: 24 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.546304:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752537 expref: 23 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845462.546312:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:1.0:1788845462.546315:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845462.546318:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08c00, rc 0) 00000100:00100000:1.0:1788845462.546576:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+23:11381:x1875740180151552:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 639us (848us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788845462.546584:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 146 00000100:00100000:3.0:1788845462.549399:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.551116:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180151808 00000100:00100000:0.0:1788845462.551131:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180151808 00000100:00100000:0.0:1788845462.551212:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 147 00000100:00100000:0.0:1788845462.551222:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+23:11381:x1875740180151808:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845462.551245:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845462.551276:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa175 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775253e expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.551398:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa17c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.551411:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa17c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.551456:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa17c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845462.551470:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788845462.551590:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa175 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775253e expref: 26 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.551610:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa17c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775253e expref: 25 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.551618:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:0.0:1788845462.551621:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788845462.551624:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845462.551693:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+25:11381:x1875740180151808:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 473us (2347us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788845462.551700:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 147 00000100:00100000:1.0:1788845462.552733:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845462.552851:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180151936 00000100:00100000:3.0:1788845462.552858:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180151936 00000100:00100000:3.0:1788845462.552923:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:3.0:1788845462.552933:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+25:2372:x1875740180151936:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845462.552947:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845462.552967:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752537 expref: 25 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.552984:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:3.0:1788845462.552988:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845462.553032:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+24:2372:x1875740180151936:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845462.553040:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1788845462.558582:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845462.558716:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180152064 00000100:00100000:3.0:1788845462.558726:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180152064 00000100:00100000:3.0:1788845462.558789:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:3.0:1788845462.558799:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2374:x1875740180152064:12345-192.168.206.35@tcp:1:lfs.0 00010000:00010000:3.0:1788845462.558845:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.558864:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.558871:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845462.558875:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845462.558878:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.558924:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.558939:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 6 pid: 6656 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845462.558953:0:6658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadfaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1875740189589632:192.168.206.35@tcp:104: 00000100:00100000:3.0:1788845462.559045:0:6658:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc93e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788845462.561902:0:6658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadfaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1875740189589632:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845462.561933:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845462.562505:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845462.562711:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180152192 00000100:00100000:3.0:1788845462.562719:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180152192 00002000:00100000:3.0:1788845462.562769:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff92ae9eb28e00 x1875740180152192/t0(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:568/0 lens 504/0 e 0 to 0 dl 1788845473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845462.562781:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ae9eb28e00 with x1875740180152192 ext(0->12) 00010000:00010000:3.0:1788845462.562789:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 7 pid: 6656 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.562804:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 7 pid: 6656 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845462.562812:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ae9eb28e00 00000100:00100000:3.0:1788845462.562845:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:3.0:1788845462.562854:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180152192:12345-192.168.206.35@tcp:4:lfs.0 00000100:00100000:3.0:1788845462.563438:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:704fd1fa-8fb6-403c-867f-b875231088ec+9:2372:x1875740180152192:12345-192.168.206.35@tcp:4:lfs.0 Request processed in 583us (933us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788845462.563448:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00002000:00100000:3.0:1788845462.563457:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff92ae9eb28e00 x1875740180152192/t4294967305(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:568/0 lens 504/448 e 0 to 0 dl 1788845473 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845462.563466:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ae9eb28e00 with x1875740180152192 ext(0->12) 00010000:00010000:3.0:1788845462.563473:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 9 pid: 6656 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.563498:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 9 pid: 6656 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845462.563506:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ae9eb28e00 00000100:00100000:1.0:1788845462.568149:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845462.568400:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180152320 00000100:00100000:3.0:1788845462.568410:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180152320 00010000:00010000:3.0:1788845462.568452:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 9 pid: 6656 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845462.568544:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:3.0:1788845462.568565:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+9:2374:x1875740180152320:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845462.568581:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788845462.568602:0:8419:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788845462.568621:0:8419:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788845461 00002000:00010000:3.0:1788845462.568623:0:8419:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788845462 00002000:00010000:3.0:1788845462.568626:0:8419:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788845461 00010000:00010000:3.0:1788845462.568632:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 9 pid: 6656 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.568646:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 9 pid: 6656 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.568667:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000061e6dec/0xd8041b54d6dfa13d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0x461ce12007752522 expref: 9 pid: 6656 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.568710:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845462.568714:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845462.568719:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.568728:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.568765:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845462.568821:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+8:2374:x1875740180152320:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 268us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845462.568830:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 63 00010000:00010000:0.0:1788845462.568913:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.568925:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.568951:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.568960:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.568975:0:6658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.568982:0:6658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845462.568987:0:6658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.568995:0:6658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.569009:0:6658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.569017:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab1193b0/0xd8041b54d6dfa18a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845462.569068:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+7:2374:x1875740180152064:12345-192.168.206.35@tcp:1:lfs.0 Request processed in 10270us (10499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845462.569076:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:1.0:1788845462.571986:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.572082:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180152576 00000100:00100000:0.0:1788845462.572092:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180152576 00000100:00100000:0.0:1788845462.572197:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:0.0:1788845462.572208:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+24:11381:x1875740180152576:12345-192.168.206.35@tcp:35:lfs.0 00000004:00010000:0.0:1788845462.572268:0:5821:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa17c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775253e expref: 24 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845462.573947:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788845462.574073:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788845462.574740:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788845462.574812:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.574832:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa128 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752514 expref: 28 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.574841:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.574879:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752514 expref: 28 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.574906:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752514 expref: 28 pid: 7234 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845462.574920:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae306680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5821:1875740189589760:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845462.575027:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845462.577725:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845462.577830:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180152704 00000100:00100000:3.0:1788845462.577840:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180152704 00010000:00010000:3.0:1788845462.577879:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa128 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752514 expref: 29 pid: 7234 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845462.577936:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:3.0:1788845462.577945:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+29:2372:x1875740180152704:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845462.577960:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845462.577967:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa128 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752514 expref: 29 pid: 7234 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.577980:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752514 expref: 29 pid: 7234 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.578023:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:3.0:1788845462.578028:0:6672:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.578037:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.578044:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.578062:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845462.578118:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+29:2372:x1875740180152704:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 173us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845462.578125:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 64 00010000:00010000:0.0:1788845462.578959:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa128 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752514 expref: 28 pid: 7234 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845462.578981:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae306680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5821:1875740189589760:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845462.579004:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.579039:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.579046:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845462.579194:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788845462.579652:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788845462.579839:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae306680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875740189589888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788845462.579991:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845462.580029:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f71900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845462.580097:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189589888 00000100:00100000:2.0:1788845462.580103:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189589888 00000100:00100000:2.0:1788845462.580151:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788845462.580161:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5821:x1875740189589888:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788845462.580261:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5821:x1875740189589888:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845462.580269:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845462.580471:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae306680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875740189589888:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788845462.581165:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788845462.581230:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae306680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875740189590016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788845462.581282:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845462.581386:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845462.581607:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189590016 00000100:00100000:1.0:1788845462.581612:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189590016 00000100:00100000:1.0:1788845462.581655:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788845462.581775:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5821:x1875740189590016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788845462.581998:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5821:x1875740189590016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 334us (714us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788845462.582016:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845462.582087:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae306680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5821:1875740189590016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788845462.582137:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788845462.582939:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.582952:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.582958:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.582964:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845462.582979:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.582987:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.583001:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:0.0:1788845462.583005:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788845462.583009:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.583015:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa191 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788845462.583230:0:5821:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788845462.583481:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788845462.583493:0:5821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 271803129569ns, next at 272803127445ns, rc = 0 00000001:00080000:0.0:1788845462.583501:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788845462.583534:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:0.0:1788845462.583537:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788845462.583544:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa17c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775253e expref: 32 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845462.583698:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+31:11381:x1875740180152576:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 11492us (11725us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788845462.583706:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00000020:00080000:0.0:1788845462.583711:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788845462.586788:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.587530:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180152832 00000100:00100000:0.0:1788845462.587542:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180152832 00000100:00100000:0.0:1788845462.587622:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 148 00000100:00100000:0.0:1788845462.587632:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+31:11381:x1875740180152832:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845462.587672:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845462.587702:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa198 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752545 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.587765:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa198 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752545 expref: 32 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.587781:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa198 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752545 expref: 32 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.587802:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845462.587806:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788845462.587810:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031600, rc 0) 00000100:00100000:0.0:1788845462.587863:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+32:11381:x1875740180152832:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 232us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845462.587870:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 148 00000100:00100000:1.0:1788845462.594350:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845462.594617:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180153088 00000100:00100000:2.0:1788845462.594627:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180153088 00000100:00100000:2.0:1788845462.594782:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:2.0:1788845462.594794:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+32:11381:x1875740180153088:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:2.0:1788845462.595044:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+33:11381:x1875740180153088:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 252us (707us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788845462.595053:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:1.0:1788845462.662909:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.663027:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180153344 00000100:00100000:0.0:1788845462.663037:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180153344 00000100:00100000:0.0:1788845462.663203:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 149 00000100:00100000:0.0:1788845462.663214:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+33:11391:x1875740180153344:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845462.663236:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845462.663255:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa19f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775254c expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845462.663347:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788845462.663512:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa19f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775254c expref: 35 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.663547:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae931ba000) 00010000:00010000:0.0:1788845462.663550:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845462.663556:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa19f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775254c expref: 35 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.663572:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845462.663638:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+34:11391:x1875740180153344:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 426us (756us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788845462.663644:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 149 00000100:00100000:1.0:1788845462.666402:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845462.666541:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180153472 00000100:00100000:3.0:1788845462.666559:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180153472 00000100:00100000:3.0:1788845462.666739:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 150 00000100:00100000:3.0:1788845462.666751:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+34:11391:x1875740180153472:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:3.0:1788845462.666823:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa1ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.666837:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa1ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.666848:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa1ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.666862:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa1b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.666899:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.666907:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.667387:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa1bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.667398:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa1bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.667405:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa1bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845462.667446:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa1bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.667459:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa1ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.667465:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa1ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.667472:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa1ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.667477:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845462.667482:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa1ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.667488:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa1ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.667509:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:3.0:1788845462.667512:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845462.667516:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa1ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.667522:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa1ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668508:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668517:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668524:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668529:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ac00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845462.668534:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668541:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668552:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae90a6fa00) 00010000:00010000:3.0:1788845462.668555:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845462.668558:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa1b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668565:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa1b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668597:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa1bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668604:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa1bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668609:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa1bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668734:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845462.668739:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa1bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668746:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa1bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668755:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:3.0:1788845462.668758:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845462.668760:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa1bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.668766:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa1bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845462.668862:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+34:11391:x1875740180153472:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 2110us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845462.668871:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 150 00000100:00100000:1.0:1788845462.671331:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.671594:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180153728 00000100:00100000:0.0:1788845462.671603:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180153728 00000100:00100000:0.0:1788845462.671792:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:0.0:1788845462.671804:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+34:11391:x1875740180153728:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845462.672258:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+35:11391:x1875740180153728:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 456us (936us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788845462.672267:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:1.0:1788845462.703787:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845462.704035:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180153984 00000100:00100000:2.0:1788845462.704045:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180153984 00000100:00100000:2.0:1788845462.704107:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 151 00000100:00100000:2.0:1788845462.704117:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+35:11394:x1875740180153984:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845462.704141:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845462.704159:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa1c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752553 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.704233:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa1c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.704285:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.704296:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.704311:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa1d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.704318:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.704323:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.704993:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa1d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705003:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705011:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845462.705021:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788845462.705129:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705137:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa1c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705143:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa1c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705159:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845462.705164:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa1c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705172:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa1c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705184:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:2.0:1788845462.705187:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845462.705191:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa1c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705196:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0e00/0xd8041b54d6dfa1c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705212:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705218:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa1d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705224:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa1d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705229:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845462.705232:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa1d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705239:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa1d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705733:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae931ba200) 00010000:00010000:2.0:1788845462.705736:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845462.705739:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa1d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705744:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa1d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705796:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa1c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752553 expref: 38 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705809:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752553 expref: 37 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.705816:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:2.0:1788845462.705818:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845462.705820:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0400, rc 0) 00000100:00100000:2.0:1788845462.705904:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+37:11394:x1875740180153984:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1788us (2129us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788845462.705912:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 151 00000100:00100000:1.0:1788845462.710156:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.710243:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180154112 00000100:00100000:0.0:1788845462.710261:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180154112 00000100:00100000:0.0:1788845462.710318:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 152 00000100:00100000:0.0:1788845462.710327:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+37:11394:x1875740180154112:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:0.0:1788845462.710433:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.710450:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.710479:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.710506:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.710512:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.710519:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.710524:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845462.710529:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.710535:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.710546:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845462.710548:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845462.710736:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.710744:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845462.710819:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+37:11394:x1875740180154112:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 493us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845462.710828:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 152 00000100:00100000:1.0:1788845462.712278:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.712736:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180154368 00000100:00100000:0.0:1788845462.712759:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180154368 00000100:00100000:0.0:1788845462.712812:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:0.0:1788845462.712822:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+37:11394:x1875740180154368:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845462.713068:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+38:11394:x1875740180154368:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 246us (797us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788845462.713076:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:3.0:1788845462.924462:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.924575:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180154624 00000100:00100000:0.0:1788845462.924585:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180154624 00000100:00100000:0.0:1788845462.924647:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 153 00000100:00100000:0.0:1788845462.924657:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+38:11426:x1875740180154624:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:0.0:1788845462.924680:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845462.924698:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775255a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.924799:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa1f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.924813:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.924826:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845462.924841:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788845462.924978:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa1ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775255a expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.924997:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775255a expref: 40 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.925026:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845462.925029:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845462.925032:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031800, rc 0) 00000100:00100000:0.0:1788845462.925090:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+40:11426:x1875740180154624:12345-192.168.206.35@tcp:101:cat.0 Request processed in 435us (652us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788845462.925097:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 153 00000100:00100000:1.0:1788845462.928342:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.928473:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180154880 00000100:00100000:0.0:1788845462.928484:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180154880 00000100:00100000:0.0:1788845462.928586:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:0.0:1788845462.928597:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+40:11426:x1875740180154880:12345-192.168.206.35@tcp:35:cat.0 00000100:00100000:0.0:1788845462.928902:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+41:11426:x1875740180154880:12345-192.168.206.35@tcp:35:cat.0 Request processed in 306us (571us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788845462.928910:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:1.0:1788845462.930010:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845462.930090:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180155008 00000100:00100000:0.0:1788845462.930097:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180155008 00000100:00100000:0.0:1788845462.930252:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:0.0:1788845462.930262:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+41:2374:x1875740180155008:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845462.930275:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845462.930300:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa1f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775255a expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.930322:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845462.930328:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845462.930392:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+40:2374:x1875740180155008:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 133us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845462.930416:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:1.0:1788845462.981242:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845462.981488:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180155264 00000100:00100000:2.0:1788845462.981498:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180155264 00000100:00100000:2.0:1788845462.981571:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 154 00000100:00100000:2.0:1788845462.981583:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+40:11432:x1875740180155264:12345-192.168.206.35@tcp:101:dd.0 00010000:00010000:2.0:1788845462.981607:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845462.981610:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788845462.981635:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752530 expref: 40 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.981685:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:2.0:1788845462.981690:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845462.981704:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa201 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752561 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.981801:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.981813:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa1d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752553 expref: 40 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.981822:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.981852:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752553 expref: 40 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845462.981864:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa1d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752553 expref: 40 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845462.981877:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae35c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189590144:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845462.981970:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae83fa9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788845462.985174:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845462.985662:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae35c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189590144:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845462.985688:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845462.986935:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180155392 00000100:00100000:3.0:1788845462.986947:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180155392 00010000:00010000:3.0:1788845462.987003:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa1d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752553 expref: 41 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845462.987081:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:3.0:1788845462.987090:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+41:2373:x1875740180155392:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845462.987115:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845462.987123:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa1d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752553 expref: 41 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.987136:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752553 expref: 41 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.987158:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa1d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752553 expref: 41 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.987185:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:3.0:1788845462.987191:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.987207:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.987214:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845462.987248:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845462.987317:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+40:2373:x1875740180155392:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 227us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845462.987325:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 65 00010000:00010000:0.0:1788845462.987402:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.987411:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845462.987430:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788845462.987617:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa201 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752561 expref: 41 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.987633:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752561 expref: 40 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845462.987641:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845462.987643:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788845462.987646:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1600, rc 0) 00000100:00100000:0.0:1788845462.987671:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+40:11432:x1875740180155264:12345-192.168.206.35@tcp:101:dd.0 Request processed in 6092us (6443us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788845462.987679:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 154 00000100:00100000:1.0:1788845462.996753:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.000205:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180155648 00000100:00100000:0.0:1788845463.000223:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180155648 00000100:00100000:0.0:1788845463.000358:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 155 00000100:00100000:0.0:1788845463.000386:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+40:11432:x1875740180155648:12345-192.168.206.35@tcp:36:dd.0 00010000:00010000:0.0:1788845463.000672:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa216 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.000689:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.000716:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845463.000767:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788845463.000787:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b47067e reply state 000000009d544cf7 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845463.000797:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845463.000893:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+43:11432:x1875740180155648:12345-192.168.206.35@tcp:36:dd.0 Request processed in 502us (4142us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788845463.000901:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 155 00000020:00080000:0.0:1788845463.000905:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788845463.006637:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.006677:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa216 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.006684:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa216 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.006689:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845463.006694:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa216 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.006701:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa216 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.006716:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:2.0:1788845463.006719:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845463.006722:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa216 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.006728:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa216 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845463.227230:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845463.227651:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180155776 00000100:00100000:3.0:1788845463.227661:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180155776 00000100:00100000:3.0:1788845463.227833:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 156 00000100:00100000:3.0:1788845463.227844:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+42:11446:x1875740180155776:12345-192.168.206.35@tcp:101:stat.0 00010000:00010000:3.0:1788845463.227868:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845463.227901:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa21d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752568 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.227974:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa224 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.227987:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.227999:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.228014:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa22b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.228021:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa22b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.228027:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa22b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.228197:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.228208:0:8176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752561 expref: 43 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.228238:0:8176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.228272:0:8176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752561 expref: 43 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.228287:0:8176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752561 expref: 43 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845463.228302:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadfae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189590272:192.168.206.35@tcp:104: 00000100:00100000:3.0:1788845463.228452:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc93e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788845463.231418:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadfae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189590272:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845463.231450:0:8176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845463.237941:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845463.239026:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180156032 00000100:00100000:3.0:1788845463.239040:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180156032 00000100:00100000:3.0:1788845463.239287:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:3.0:1788845463.239300:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+44:9248:x1875740180156032:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788845463.239683:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+45:9248:x1875740180156032:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 385us (1754us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788845463.239692:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:1.0:1788845463.243782:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845463.243897:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180156160 00000100:00100000:2.0:1788845463.243909:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180156160 00010000:00010000:2.0:1788845463.243953:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752561 expref: 45 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845463.243999:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00100000:2.0:1788845463.244010:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+45:2372:x1875740180156160:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845463.244024:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845463.244049:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752561 expref: 45 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.244062:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752561 expref: 45 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.244083:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa208 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752561 expref: 45 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.244113:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:2.0:1788845463.244118:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.244128:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.244135:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.244172:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845463.244239:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+44:2372:x1875740180156160:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 232us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845463.244248:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 66 00010000:00010000:0.0:1788845463.244430:0:8176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244440:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845463.244489:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788845463.244494:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845463.244515:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244529:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244539:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244546:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa224 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244564:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244571:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ac00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.244575:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244583:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa224 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244592:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845463.244595:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.244599:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244606:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244631:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa22b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244637:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa22b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244643:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa22b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244648:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.244651:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa22b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244668:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa22b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244678:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae90a6fa00) 00010000:00010000:0.0:1788845463.244680:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.244683:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa22b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244688:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa22b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244725:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa21d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752568 expref: 44 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244738:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752568 expref: 43 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.244745:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845463.244747:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845463.244750:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b000, rc 0) 00000100:00100000:0.0:1788845463.244779:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+43:11446:x1875740180155776:12345-192.168.206.35@tcp:101:stat.0 Request processed in 16938us (17613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845463.244788:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 156 00000100:00100000:1.0:1788845463.305496:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.305775:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180156416 00000100:00100000:0.0:1788845463.305785:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180156416 00000100:00100000:0.0:1788845463.305898:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 157 00000100:00100000:0.0:1788845463.305910:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+43:11452:x1875740180156416:12345-192.168.206.35@tcp:36:truncate.0 00010000:00010000:0.0:1788845463.305995:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845463.306021:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752568 expref: 43 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.306041:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845463.306046:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845463.306292:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa239 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.306305:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.306314:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845463.306414:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788845463.306441:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008663bf53 reply state 00000000d9e4ce70 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845463.306451:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845463.307141:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+45:11452:x1875740180156416:12345-192.168.206.35@tcp:36:truncate.0 Request processed in 1229us (1653us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788845463.307150:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 157 00000020:00080000:0.0:1788845463.307155:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788845463.309852:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa239 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.309872:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa239 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.309880:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa239 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.309914:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.309920:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa239 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.309928:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa239 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.309944:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845463.309947:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.309951:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa239 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.309958:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa239 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.389523:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845463.451669:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.451768:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180156544 00000100:00100000:0.0:1788845463.451779:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180156544 00000100:00100000:0.0:1788845463.451845:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 158 00000100:00100000:0.0:1788845463.451857:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+44:11466:x1875740180156544:12345-192.168.206.35@tcp:101:stat.0 00010000:00010000:0.0:1788845463.451881:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845463.451911:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa240 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775256f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.451978:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa247 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.451993:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452025:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452041:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa24e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452049:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa24e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452056:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa24e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452149:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452157:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452179:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845463.452216:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788845463.452220:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845463.452240:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452252:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452260:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452277:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa247 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452282:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa247 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452288:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.452293:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa247 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452301:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa247 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452314:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845463.452316:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.452320:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa247 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452326:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa247 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452342:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa24e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.452347:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa24e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.453139:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa24e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.453146:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.453158:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa24e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.453165:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa24e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.453175:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae83de9900) 00010000:00010000:0.0:1788845463.453178:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.453182:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa24e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.453188:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa24e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.453615:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa240 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775256f expref: 46 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.453631:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775256f expref: 45 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.453639:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845463.453641:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845463.453644:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030600, rc 0) 00000100:00100000:0.0:1788845463.453713:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+45:11466:x1875740180156544:12345-192.168.206.35@tcp:101:stat.0 Request processed in 1859us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845463.453722:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 158 00000100:00100000:1.0:1788845463.530328:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.530739:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180156800 00000100:00100000:0.0:1788845463.530750:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180156800 00000100:00100000:0.0:1788845463.530822:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 159 00000100:00100000:0.0:1788845463.530834:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+45:11476:x1875740180156800:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845463.530868:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845463.530907:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa25c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752576 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845463.531000:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788845463.531287:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa25c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752576 expref: 47 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.531301:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae931ba000) 00010000:00010000:0.0:1788845463.531305:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845463.531309:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa25c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752576 expref: 47 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.531325:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845463.531422:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+46:11476:x1875740180156800:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 591us (1108us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788845463.531429:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 159 00000100:00100000:1.0:1788845463.545196:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.546974:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180157056 00000100:00100000:0.0:1788845463.546990:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180157056 00000100:00100000:0.0:1788845463.547217:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:0.0:1788845463.547227:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+46:11476:x1875740180157056:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845463.547760:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+47:11476:x1875740180157056:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 534us (2577us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788845463.547768:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:1.0:1788845463.615985:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.616087:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180157312 00000100:00100000:0.0:1788845463.616097:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180157312 00000100:00100000:0.0:1788845463.616173:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 160 00000100:00100000:0.0:1788845463.616203:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+47:11482:x1875740180157312:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1788845463.616227:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845463.616247:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa26a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775257d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.616357:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.616414:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775256f expref: 48 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.616423:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.616458:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775256f expref: 48 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.616472:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775256f expref: 48 pid: 5819 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845463.616485:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae305500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189590400:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845463.616591:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f71780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845463.620301:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845463.620484:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180157440 00000100:00100000:3.0:1788845463.620495:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180157440 00010000:00010000:3.0:1788845463.620535:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775256f expref: 49 pid: 5819 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845463.620615:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:3.0:1788845463.620625:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+49:2372:x1875740180157440:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845463.620639:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845463.620646:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775256f expref: 49 pid: 5819 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.620659:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775256f expref: 49 pid: 5819 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.620680:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:3.0:1788845463.620685:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.620694:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.620702:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.620719:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845463.620770:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+49:2372:x1875740180157440:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 146us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845463.620777:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 67 00010000:00010000:0.0:1788845463.620984:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa255 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775256f expref: 48 pid: 5819 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845463.621002:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae305500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5818:1875740189590400:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845463.621025:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.621044:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.621049:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845463.621068:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788845463.621239:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa26a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775257d expref: 49 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.621255:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775257d expref: 48 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.621262:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845463.621265:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788845463.621267:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030200, rc 0) 00000100:00100000:0.0:1788845463.621295:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+48:11482:x1875740180157312:12345-192.168.206.35@tcp:101:bash.0 Request processed in 5096us (5323us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788845463.621303:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 160 00000100:00100000:3.0:1788845463.624067:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.624193:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180157696 00000100:00100000:0.0:1788845463.624203:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180157696 00000100:00100000:0.0:1788845463.624263:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 161 00000100:00100000:0.0:1788845463.624273:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadfae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+48:11482:x1875740180157696:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:0.0:1788845463.624590:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa27f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.624606:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa27f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.624632:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa27f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845463.624692:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788845463.624718:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032197703 reply state 00000000ef37e110 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa27f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845463.624728:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845463.624819:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadfae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+51:11482:x1875740180157696:12345-192.168.206.35@tcp:36:bash.0 Request processed in 546us (765us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788845463.624826:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 161 00000020:00080000:0.0:1788845463.624830:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788845463.626927:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa27f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.626948:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa27f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.626956:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa27f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.626984:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845463.626990:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa27f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.626997:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa27f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.627024:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:2.0:1788845463.627028:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845463.627039:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa27f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.627046:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa27f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845463.632360:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.632563:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180157824 00000100:00100000:0.0:1788845463.632573:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180157824 00000100:00100000:0.0:1788845463.632865:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 162 00000100:00100000:0.0:1788845463.632877:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+50:11482:x1875740180157824:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1788845463.632911:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845463.632930:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa286 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752584 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.633099:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa28d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.633113:0:8176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775257d expref: 51 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.633121:0:8176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa28d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.633296:0:8176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775257d expref: 51 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.633310:0:8176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775257d expref: 51 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845463.633324:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae305500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189590528:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845463.633475:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f71840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845463.637909:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.637958:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae305500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189590528:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845463.637992:0:8176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa28d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845463.638066:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180157952 00000100:00100000:3.0:1788845463.638073:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180157952 00010000:00010000:3.0:1788845463.638130:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775257d expref: 52 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845463.638407:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:2.0:1788845463.638420:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+52:2372:x1875740180157952:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845463.638435:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845463.638442:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775257d expref: 52 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.638455:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775257d expref: 52 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.638477:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa271 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775257d expref: 52 pid: 5818 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.638498:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:2.0:1788845463.638510:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa28d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.638519:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa28d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.638526:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa28d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.638550:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845463.638574:0:8176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa28d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.638581:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa28d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845463.638626:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788845463.638631:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1788845463.638646:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+51:2372:x1875740180157952:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 230us (745us total) trans 0 rc 0/0 00000004:00010000:0.0:1788845463.638650:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa28d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845463.638653:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 68 00010000:00010000:0.0:1788845463.638678:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa286 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752584 expref: 51 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.638692:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa28d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752584 expref: 50 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.638712:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845463.638714:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845463.638717:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030600, rc 0) 00000100:00100000:0.0:1788845463.639108:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+50:11482:x1875740180157824:12345-192.168.206.35@tcp:101:bash.0 Request processed in 6232us (6760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845463.639116:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 162 00000100:00100000:1.0:1788845463.643167:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845463.643308:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180158208 00000100:00100000:3.0:1788845463.643318:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180158208 00000100:00100000:3.0:1788845463.643550:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:3.0:1788845463.643561:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+50:11482:x1875740180158208:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:3.0:1788845463.643788:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+51:11482:x1875740180158208:12345-192.168.206.35@tcp:35:bash.0 Request processed in 228us (633us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788845463.643797:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:1.0:1788845463.710119:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.710215:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180158464 00000100:00100000:0.0:1788845463.710225:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180158464 00000100:00100000:0.0:1788845463.710292:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 163 00000100:00100000:0.0:1788845463.710303:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+51:11492:x1875740180158464:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845463.710327:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845463.710347:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa294 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775258b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845463.710471:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788845463.710598:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa294 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775258b expref: 53 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.710611:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae931ba000) 00010000:00010000:0.0:1788845463.710613:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845463.710618:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa294 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775258b expref: 53 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.710632:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845463.710695:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+52:11492:x1875740180158464:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 394us (589us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788845463.710724:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 163 00000100:00100000:1.0:1788845463.715181:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.715482:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180158592 00000100:00100000:0.0:1788845463.715491:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180158592 00000100:00100000:0.0:1788845463.715540:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 164 00000100:00100000:0.0:1788845463.715551:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+52:11492:x1875740180158592:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:0.0:1788845463.715627:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa2a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715643:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa2a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715654:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa2a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715670:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa2a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715678:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715685:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715784:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715794:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715801:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845463.715853:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715867:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa2a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715874:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa2a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715894:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa2a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715901:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.715905:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa2a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715911:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa2a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715923:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845463.715925:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.715930:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa2a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715935:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa2a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715962:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715970:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa2a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715983:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715989:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.715992:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.715999:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa2a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.716007:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae83de9900) 00010000:00010000:0.0:1788845463.716010:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.716013:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa2a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.716019:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa2a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.716046:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.716052:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.716067:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.716073:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1ee00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.716076:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.716092:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.716101:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845463.716104:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.716106:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.716112:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845463.716204:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+52:11492:x1875740180158592:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 654us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845463.716211:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 164 00000100:00100000:3.0:1788845463.718482:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845463.718648:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180158848 00000100:00100000:1.0:1788845463.718658:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180158848 00000100:00100000:1.0:1788845463.718756:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:1.0:1788845463.718767:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+52:11492:x1875740180158848:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:1.0:1788845463.719044:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+53:11492:x1875740180158848:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 277us (571us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788845463.719061:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:2.0:1788845463.757198:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.757310:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180159104 00000100:00100000:0.0:1788845463.757320:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180159104 00000100:00100000:0.0:1788845463.757421:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 165 00000100:00100000:0.0:1788845463.757432:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+53:11495:x1875740180159104:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845463.757454:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845463.757474:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752592 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757557:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa2be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757571:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa2be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757581:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa2be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757680:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757689:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757697:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757818:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa2cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757828:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa2cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757835:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa2cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845463.757845:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788845463.757957:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa2be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757965:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa2be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757973:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa2be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.757979:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1f200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.757984:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa2be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758001:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa2be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758013:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845463.758016:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.758020:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa2be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758026:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa2be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758041:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758047:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758054:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758059:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1f400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.758062:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758068:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758075:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae83de9900) 00010000:00010000:0.0:1788845463.758077:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.758080:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758095:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758138:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752592 expref: 56 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758152:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa2cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752592 expref: 55 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.758159:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845463.758161:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845463.758164:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1fe00, rc 0) 00000100:00100000:0.0:1788845463.758227:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+55:11495:x1875740180159104:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 797us (1041us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788845463.758234:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 165 00000100:00100000:2.0:1788845463.762132:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845463.762230:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180159232 00000100:00100000:1.0:1788845463.762239:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180159232 00000100:00100000:1.0:1788845463.762298:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 166 00000100:00100000:1.0:1788845463.762313:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+55:11495:x1875740180159232:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:1.0:1788845463.762408:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.762423:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.762434:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.762462:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.762469:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.762475:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.762481:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09a00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845463.762503:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.762511:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.762523:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:1.0:1788845463.762526:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845463.762531:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.762537:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845463.763689:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845463.764159:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180159360 00000100:00100000:3.0:1788845463.764166:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180159360 00000100:00100000:3.0:1788845463.764223:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:3.0:1788845463.764231:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+56:2373:x1875740180159360:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845463.764243:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845463.764261:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa2cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752592 expref: 56 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845463.764278:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:3.0:1788845463.764281:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845463.764324:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+55:2373:x1875740180159360:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 93us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845463.764331:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1788845463.764438:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+54:11495:x1875740180159232:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 2125us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845463.764448:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 166 00000100:00100000:2.0:1788845463.766529:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845463.766558:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180159616 00000100:00100000:3.0:1788845463.766566:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180159616 00000100:00100000:3.0:1788845463.766611:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:3.0:1788845463.766638:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+54:11495:x1875740180159616:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:3.0:1788845463.766939:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+55:11495:x1875740180159616:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 302us (430us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788845463.766947:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:2.0:1788845463.876299:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845463.876424:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180159872 00000100:00100000:1.0:1788845463.876445:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180159872 00000100:00100000:1.0:1788845463.876509:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 167 00000100:00100000:1.0:1788845463.876518:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+55:11513:x1875740180159872:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:1.0:1788845463.876540:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845463.876558:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752599 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.876674:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa2e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.876688:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa2e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.876720:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa2e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845463.876732:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788845463.876860:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa2e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752599 expref: 58 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.876890:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa2e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752599 expref: 57 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845463.876898:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:1.0:1788845463.876900:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788845463.876904:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09200, rc 0) 00000100:00100000:1.0:1788845463.876963:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+57:11513:x1875740180159872:12345-192.168.206.35@tcp:101:cat.0 Request processed in 446us (677us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788845463.876970:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 167 00000100:00100000:2.0:1788845463.901055:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.901249:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180160000 00000100:00100000:0.0:1788845463.901260:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180160000 00000100:00100000:0.0:1788845463.901337:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 168 00000100:00100000:0.0:1788845463.901348:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+57:11514:x1875740180160000:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845463.901403:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845463.901427:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525a0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.901531:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.901546:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.901631:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845463.901676:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788845463.901680:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845463.901699:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.901727:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa2f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525a0 expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.901750:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525a0 expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.901759:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845463.901761:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845463.901765:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f400, rc 0) 00000100:00100000:0.0:1788845463.901892:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+58:11514:x1875740180160000:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 545us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845463.901898:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 168 00000100:00100000:2.0:1788845463.912334:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845463.912468:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180160384 00000100:00100000:3.0:1788845463.912478:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180160384 00000100:00100000:3.0:1788845463.912537:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:3.0:1788845463.912557:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+58:11514:x1875740180160384:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:3.0:1788845463.913053:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+59:11514:x1875740180160384:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 497us (730us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788845463.913062:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:3.0:1788845463.918153:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845463.918742:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180160512 00000100:00100000:2.0:1788845463.918755:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180160512 00000100:00100000:2.0:1788845463.918893:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:2.0:1788845463.918904:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb967d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+59:11514:x1875740180160512:12345-192.168.206.35@tcp:103:lfs.0 00010000:00010000:2.0:1788845463.918922:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788845463.918945:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa28d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752584 expref: 59 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.918975:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa2e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752599 expref: 58 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.919008:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752545 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845463.919019:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:2.0:1788845463.919030:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845463.919092:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb967d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+56:11514:x1875740180160512:12345-192.168.206.35@tcp:103:lfs.0 Request processed in 190us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845463.919099:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:1.0:1788845463.924114:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.925757:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180160640 00000100:00100000:0.0:1788845463.925774:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180160640 00000100:00100000:0.0:1788845463.925925:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 169 00000100:00100000:0.0:1788845463.925937:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+56:11514:x1875740180160640:12345-192.168.206.35@tcp:58:lfs.0 00010000:00010000:0.0:1788845463.926048:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa304 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.926064:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa304 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.926093:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa304 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788845463.926320:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788845463.926450:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+56:11514:x1875740180160640:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 515us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845463.926459:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 169 00000100:00100000:1.0:1788845463.949260:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845463.954786:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180160768 00000100:00100000:0.0:1788845463.954804:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180160768 00000100:00100000:0.0:1788845463.954969:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 170 00000100:00100000:0.0:1788845463.954981:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+56:11516:x1875740180160768:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845463.955007:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845463.955042:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa30b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525a7 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.955120:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfa312 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.955134:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfa312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.955144:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfa312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.955161:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.955168:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.955219:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.955322:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.955331:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.955338:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845463.956044:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788845463.956050:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845463.956072:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956088:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956160:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfa312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956168:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfa312 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956338:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfa312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956347:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1fc00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.956619:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfa312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956762:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfa312 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956778:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845463.956781:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.956786:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfa312 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956792:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfa312 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956813:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956819:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa319 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956825:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956831:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1fe00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845463.956833:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956840:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956846:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae83de9c00) 00010000:00010000:0.0:1788845463.956848:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845463.956851:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa319 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.956866:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.957031:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfa30b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525a7 expref: 58 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.957050:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525a7 expref: 57 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845463.957058:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9900) 00010000:00010000:0.0:1788845463.957060:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845463.957063:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031600, rc 0) 00000100:00100000:0.0:1788845463.957283:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+57:11516:x1875740180160768:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 2303us (8035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845463.957292:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 170 00010000:00010000:1.0:1788845464.411647:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788845464.540903:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845464.540913:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788845464.540966:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788845464.540973:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788845464.541093:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae224000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189590656:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788845464.541186:0:11641:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeae210d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788845464.547129:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845464.547168:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180160896 00000100:00100000:2.0:1788845464.547176:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180160896 00000100:00100000:2.0:1788845464.547243:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 171 00000100:00100000:2.0:1788845464.547252:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+58:11527:x1875740180160896:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788845464.547282:0:5817:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788845464.547395:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+58:11527:x1875740180160896:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 144us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845464.547403:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 171 00000100:00080000:2.0:1788845464.547427:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845464.547659:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae224000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189590656:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788845464.555042:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845464.556034:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180161024 00000100:00100000:3.0:1788845464.556046:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180161024 00000100:00100000:3.0:1788845464.556142:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 172 00000100:00100000:3.0:1788845464.556152:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+57:11527:x1875740180161024:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788845464.556219:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa327 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556235:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa327 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556246:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa327 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556261:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa32e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556281:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa32e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556289:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa32e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556319:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa335 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556328:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556334:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845464.556388:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788845464.556392:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845464.556405:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556417:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa327 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556424:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa327 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556430:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa327 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556437:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845464.556442:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa327 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556457:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa327 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556469:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:3.0:1788845464.556472:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845464.556476:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa327 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556482:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa327 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556494:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa32e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556500:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa32e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556506:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa32e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556511:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845464.556513:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa32e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556519:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa32e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556526:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff92ae90a6f000) 00010000:00010000:3.0:1788845464.556529:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845464.556531:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa32e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556546:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa32e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556562:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556568:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa335 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556574:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556579:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ba00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845464.556581:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556587:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa335 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556594:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9900) 00010000:00010000:3.0:1788845464.556596:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845464.556599:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa335 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.556604:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa335 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845464.556685:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+57:11527:x1875740180161024:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 Request processed in 533us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845464.556692:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 172 00000100:00100000:1.0:1788845464.565496:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845464.569515:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180161280 00000100:00100000:2.0:1788845464.569532:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180161280 00000100:00100000:2.0:1788845464.569595:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 173 00000100:00100000:2.0:1788845464.569607:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+57:11527:x1875740180161280:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845464.569626:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845464.569646:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa33c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525ae expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.569756:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa343 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.569770:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.569782:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845464.569793:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788845464.571786:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.571803:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa343 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.571811:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.571817:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845464.571822:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.571829:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa343 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.571843:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9900) 00010000:00010000:2.0:1788845464.571846:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845464.571851:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa343 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.571867:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa343 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.571929:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa33c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525ae expref: 59 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.571941:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:2.0:1788845464.571943:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845464.571959:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa33c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525ae expref: 59 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.571970:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0a00, rc 0) 00000100:00100000:2.0:1788845464.572050:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+58:11527:x1875740180161280:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 2445us (6565us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788845464.572059:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 173 00000100:00100000:2.0:1788845464.585573:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000040:00080000:1.0:1788845464.586578:0:12465:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845464.586585:0:12465:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788845464.586628:0:12465:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788845464.586634:0:12465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788845464.587001:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180161408 00000100:00100000:3.0:1788845464.587011:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180161408 00000100:00100000:3.0:1788845464.587067:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 174 00000100:00100000:3.0:1788845464.587078:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+58:11527:x1875740180161408:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788845464.587107:0:7234:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788845464.587220:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+58:11527:x1875740180161408:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 144us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845464.587229:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 174 00000100:00100000:0.0:1788845464.592489:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845464.592621:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180161664 00000100:00100000:3.0:1788845464.592631:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180161664 00000100:00100000:3.0:1788845464.592702:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 175 00000100:00100000:3.0:1788845464.592714:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+58:11527:x1875740180161664:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845464.592736:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845464.592740:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788845464.592765:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f400/0xd8041b54d6dfa2fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525a0 expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.592788:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:3.0:1788845464.592793:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845464.592806:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa351 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525b5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788845464.593251:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788845464.593504:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa358 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.593517:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.593535:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.593593:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa351 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525b5 expref: 60 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.593609:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525b5 expref: 59 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.593617:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae90a6f000) 00010000:00010000:3.0:1788845464.593621:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845464.593623:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a600, rc 0) 00000100:00100000:3.0:1788845464.593679:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+59:11527:x1875740180161664:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 967us (1201us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788845464.593688:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 175 00000100:00100000:1.0:1788845464.601581:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845464.601756:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180161920 00000100:00100000:2.0:1788845464.601765:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180161920 00000100:00100000:2.0:1788845464.601844:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 176 00000100:00100000:2.0:1788845464.601853:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+59:11527:x1875740180161920:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788845464.601919:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845464.601943:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa358 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525b5 expref: 59 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.601962:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae90a6f000) 00010000:00010000:2.0:1788845464.601971:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845464.602000:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa366 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602012:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa366 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602021:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa366 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602068:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa36d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x143c4de5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602075:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa36d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x143c4de5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602082:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa36d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x143c4de5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602144:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa366 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602151:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa366 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602158:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa366 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602163:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845464.602167:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa366 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602174:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa366 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602201:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:2.0:1788845464.602204:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845464.602210:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa366 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602217:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa366 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602227:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa36d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x143c4de5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602233:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa36d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x143c4de5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602239:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa36d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x143c4de5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602244:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845464.602247:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa36d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x143c4de5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602253:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa36d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x143c4de5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602259:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x143c4de5 (ffff92ae931ba200) 00010000:00010000:2.0:1788845464.602262:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845464.602264:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa36d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x143c4de5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.602270:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa36d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x143c4de5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845464.602355:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+58:11527:x1875740180161920:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 502us (784us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788845464.602385:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 176 00000100:00100000:2.0:1788845464.609449:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845464.609499:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180162048 00000100:00100000:0.0:1788845464.609510:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180162048 00000100:00100000:0.0:1788845464.609578:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 177 00000100:00100000:0.0:1788845464.609589:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+58:11527:x1875740180162048:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845464.609608:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845464.609632:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa374 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.609670:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa37b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.609705:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa37b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.609716:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa37b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.609830:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa374 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525bc expref: 60 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.609850:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa37b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525bc expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.609859:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:0.0:1788845464.609862:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788845464.609865:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030600, rc 0) 00000100:00100000:0.0:1788845464.609936:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+59:11527:x1875740180162048:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 349us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845464.609943:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 177 00000100:00100000:0.0:1788845464.614524:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845464.614594:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180162304 00000100:00100000:2.0:1788845464.614605:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180162304 00000100:00100000:2.0:1788845464.614670:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 178 00000100:00100000:2.0:1788845464.614681:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+59:11527:x1875740180162304:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788845464.614792:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa382 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.614810:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.614822:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788845464.615189:0:8176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1788845464.615200:0:8176:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 273834837281ns, next at 274834834690ns, rc = 0 00000004:00010000:2.0:1788845464.615294:0:8176:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f272377 reply state 00000000ec40012d transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845464.615304:0:8176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845464.615435:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+61:11527:x1875740180162304:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 755us (925us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788845464.615444:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 178 00000100:00100000:1.0:1788845464.619021:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845464.619166:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180162432 00000100:00100000:0.0:1788845464.619177:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180162432 00000100:00100000:0.0:1788845464.619254:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 179 00000100:00100000:0.0:1788845464.619266:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+61:11527:x1875740180162432:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845464.619289:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845464.619309:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa389 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.619423:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525c3 expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.619439:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525c3 expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.619459:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:0.0:1788845464.619463:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788845464.619467:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030200, rc 0) 00000100:00100000:0.0:1788845464.619575:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+62:11527:x1875740180162432:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 311us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845464.619582:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 179 00010000:00010000:2.0:1788845464.620036:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.620057:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa382 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.620065:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.620072:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845464.620078:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.620086:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa382 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.620100:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:2.0:1788845464.620103:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788845464.620108:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa382 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.620115:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa382 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845464.623468:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845464.623555:0:12028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180162560 00000100:00100000:0.0:1788845464.623565:0:12028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180162560 00000100:00100000:0.0:1788845464.623684:0:12028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:0.0:1788845464.623699:0:12028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180162560:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788845464.624110:0:12028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180162560:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 416us (651us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788845464.624118:0:12028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00080000:2.0:1788845464.624775:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845464.628088:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845464.628173:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180162816 00000100:00100000:0.0:1788845464.628183:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180162816 00000100:00100000:0.0:1788845464.628426:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:0.0:1788845464.628437:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+61:11527:x1875740180162816:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788845464.628701:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+62:11527:x1875740180162816:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 265us (624us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788845464.628718:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:3.0:1788845464.639691:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845464.639774:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180163072 00000100:00100000:0.0:1788845464.639785:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180163072 00000100:00100000:0.0:1788845464.639847:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 180 00000100:00100000:0.0:1788845464.639858:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+62:11527:x1875740180163072:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788845464.639971:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+62:11527:x1875740180163072:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 115us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845464.639980:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 180 00000100:00100000:2.0:1788845464.645315:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845464.645610:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180163200 00000100:00100000:3.0:1788845464.645621:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180163200 00000100:00100000:3.0:1788845464.645682:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 181 00000100:00100000:3.0:1788845464.645693:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+62:11527:x1875740180163200:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845464.645713:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845464.645733:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa390 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525ca expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.645803:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.645832:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.645844:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845464.645893:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845464.645912:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.645937:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa390 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525ca expref: 64 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.645955:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525ca expref: 63 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.645963:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:3.0:1788845464.645966:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788845464.645969:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b400, rc 0) 00000100:00100000:3.0:1788845464.646025:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+63:11527:x1875740180163200:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 334us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845464.646032:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 181 00000100:00100000:0.0:1788845464.649094:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845464.649223:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180163328 00000100:00100000:3.0:1788845464.649233:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180163328 00000100:00100000:3.0:1788845464.649289:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:3.0:1788845464.649300:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180163328:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845464.649316:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845464.649351:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfa39e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525d1 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845464.649402:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9d98, blocks: 0x1 00010000:00010000:3.0:1788845464.649420:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=273s v=(0 0) 00010000:00010000:3.0:1788845464.649425:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845464.649434:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfa39e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525d1 expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.649450:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfa39e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525d1 expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.649463:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b800, rc 0) 00000100:00100000:3.0:1788845464.649513:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180163328:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 215us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845464.649520:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:0.0:1788845464.655533:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845464.655707:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180163584 00000100:00100000:2.0:1788845464.655717:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180163584 00000100:00100000:2.0:1788845464.655769:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 182 00000100:00100000:2.0:1788845464.655780:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+63:11527:x1875740180163584:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788845464.657589:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+63:11527:x1875740180163584:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 1167us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845464.657607:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 182 00000100:00100000:2.0:1788845464.660001:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845464.660207:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180163712 00000100:00100000:0.0:1788845464.660217:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180163712 00000100:00100000:0.0:1788845464.660276:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:0.0:1788845464.660286:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+8:11527:x1875740180163712:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845464.660304:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845464.660320:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525d8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.660351:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfa39e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525d1 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.660380:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845464.660385:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845464.660390:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 9 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.660436:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfa39e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d1 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.660449:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfa39e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d1 expref: 9 pid: 6659 timeout: 373 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845464.660464:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1875740189590784:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845464.660551:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f71840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845464.667496:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1875740189590784:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845464.667538:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 9 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845464.667611:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845464.667913:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180163840 00000100:00100000:3.0:1788845464.667922:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180163840 00010000:00010000:3.0:1788845464.667969:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfa39e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d1 expref: 10 pid: 6659 timeout: 373 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845464.668023:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:3.0:1788845464.668037:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+10:2373:x1875740180163840:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845464.668051:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845464.668077:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfa39e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d1 expref: 10 pid: 6659 timeout: 373 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.668174:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfa39e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d1 expref: 10 pid: 6659 timeout: 373 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.668198:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfa39e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d1 expref: 10 pid: 6659 timeout: 373 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.668214:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845464.668219:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845464.668227:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 9 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.668237:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 9 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.668276:0:8419:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 9 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845464.668290:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb74e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8419:1875740189590912:192.168.206.35@tcp:105: 00000100:00100000:3.0:1788845464.668396:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae82f03240 going to sleep for 11 seconds 00010000:00010000:2.0:1788845464.668445:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:2.0:1788845464.668472:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+9:11527:x1875740180163712:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 8188us (8485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845464.668479:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:3.0:1788845464.670592:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb74e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8419:1875740189590912:192.168.206.35@tcp:105: 00010000:00010000:3.0:1788845464.670618:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845464.671946:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180163840:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 3903us (4328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845464.671960:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:1.0:1788845464.672210:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845464.672799:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180163968 00000100:00100000:3.0:1788845464.672808:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180163968 00002000:00100000:3.0:1788845464.672855:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff92aeae224700 x1875740180163968/t0(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:570/0 lens 504/0 e 0 to 0 dl 1788845475 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845464.672867:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeae224700 with x1875740180163968 ext(0->8) 00002000:00010000:3.0:1788845464.672873:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeae224700 00000100:00100000:3.0:1788845464.673252:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:3.0:1788845464.673264:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180163968:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788845464.673808:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:704fd1fa-8fb6-403c-867f-b875231088ec+10:2373:x1875740180163968:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 Request processed in 544us (1596us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788845464.673816:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00002000:00100000:3.0:1788845464.673823:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff92aeae224700 x1875740180163968/t4294967314(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:570/0 lens 504/448 e 0 to 0 dl 1788845475 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845464.673831:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeae224700 with x1875740180163968 ext(0->8) 00002000:00010000:3.0:1788845464.673836:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeae224700 00000100:00100000:1.0:1788845464.681234:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845464.681329:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180164096 00000100:00100000:3.0:1788845464.681339:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180164096 00000100:00100000:3.0:1788845464.681434:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 183 00000100:00100000:3.0:1788845464.681444:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+63:11527:x1875740180164096:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788845464.724101:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788845464.724163:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788845464.724186:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ad82f71900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788845464.724192:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ae9eae0200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ad82f719c0 00000020:00080000:0.0:1788845464.724195:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ae82ac9800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92aebc5d6800 00000004:00080000:0.0:1788845464.724228:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:3.0:1788845464.724314:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+18:11527:x1875740180164096:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 Request processed in 42863us (43087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845464.724325:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 183 00000020:00080000:3.0:1788845464.724397:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1788845464.724411:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ae8fcbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189591040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788845464.724472:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788845464.724614:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788845464.724629:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189591040 00000100:00100000:3.0:1788845464.724641:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189591040 00000100:00100000:3.0:1788845464.724691:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788845464.724699:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1875740189591040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788845464.724720:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1788845464.724752:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f9d95, atime: 0x6a9f9d96, ctime: 0x6a9f9d95, blocks: 0x1 00010000:00010000:3.0:1788845464.724760:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002491e0a0/0xd8041b54d6dfa3ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.724776:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=273s v=(0 0) 00010000:00010000:3.0:1788845464.724780:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845464.724786:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002491e0a0/0xd8041b54d6dfa3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.724805:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002491e0a0/0xd8041b54d6dfa3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.724815:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002491e0a0/0xd8041b54d6dfa3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.724823:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002491e0a0/0xd8041b54d6dfa3ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.724839:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788845464.725310:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3283:x1875740189591040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 611us (837us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788845464.725318:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:3.0:1788845464.725343:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845464.725355:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002491e0a0/0xd8041b54d6dfa3ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.725390:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845464.725393:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002491e0a0/0xd8041b54d6dfa3ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.725402:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002491e0a0/0xd8041b54d6dfa3ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.725418:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002491e0a0/0xd8041b54d6dfa3ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.725425:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002491e0a0/0xd8041b54d6dfa3ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.725444:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845464.725446:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845464.725448:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788845464.725478:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ae8fcbe680/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788845464.725485:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ae8fcbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189591040:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1788845464.725837:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845464.726145:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189591168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788845464.726194:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845464.726945:0:12028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189591168 00000100:00100000:1.0:1788845464.726953:0:12028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189591168 00000100:00100000:1.0:1788845464.727077:0:12028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788845464.727088:0:12028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189591168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788845464.727743:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845464.728004:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180164224 00000100:00100000:0.0:1788845464.728010:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180164224 00000100:00100000:0.0:1788845464.728045:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:0.0:1788845464.728054:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+10:2372:x1875740180164224:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 00002000:00010000:1.0:1788845464.728804:0:12028:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788845464.728810:0:12028:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788845464 00002000:00010000:1.0:1788845464.728812:0:12028:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788845464.728815:0:12028:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788845464 -> 1788845464 00002000:00010000:1.0:1788845464.728817:0:12028:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788845464.728896:0:12028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1875740189591168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1810us (2700us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788845464.728904:0:12028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788845464.728942:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788845464.730029:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92aeadd11500/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788845464.730042:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189591168:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1788845464.777648:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1788845464.779008:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1788845464.779144:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1788845464.779452:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180164224:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 Request processed in 51392us (51707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845464.779463:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:1.0:1788845464.786270:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845464.786568:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180164480 00000100:00100000:2.0:1788845464.786577:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180164480 00000100:00100000:2.0:1788845464.786631:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 184 00000100:00100000:2.0:1788845464.786641:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+18:11527:x1875740180164480:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788845464.786693:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845464.786718:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525ca expref: 18 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.786737:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:2.0:1788845464.786741:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845464.786771:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa3b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.786782:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa3b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.786802:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa3b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845464.787115:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076145cee reply state 00000000e28c285b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa3b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845464.787126:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845464.787243:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+19:11527:x1875740180164480:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 603us (987us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788845464.787251:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 184 00010000:00010000:0.0:1788845464.789740:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa3b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.789763:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa3b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.789770:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa3b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.789777:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845464.789783:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa3b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.789791:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa3b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.789806:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:0.0:1788845464.789809:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845464.789814:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa3b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.789821:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa3b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845464.789830:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845464.789936:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180164608 00000100:00100000:1.0:1788845464.790008:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180164608 00000100:00100000:1.0:1788845464.790062:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:1.0:1788845464.790072:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180164608:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788845464.791182:0:6656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788845464.791190:0:6656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788845464 -> 1788845463 00002000:00010000:0.0:1788845464.791193:0:6656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788845462 00002000:00010000:0.0:1788845464.791195:0:6656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788845464 -> 1788845463 00002000:00010000:0.0:1788845464.791218:0:6656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788845464.791293:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+8:2372:x1875740180164608:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 1218us (1467us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788845464.791302:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:3.0:1788845464.793874:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845464.794104:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180164864 00000100:00100000:2.0:1788845464.794114:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180164864 00000100:00100000:2.0:1788845464.794396:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 185 00000100:00100000:2.0:1788845464.794408:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+18:11527:x1875740180164864:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788845464.794484:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.794501:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa37b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525bc expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.794510:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.794544:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa37b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525bc expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.794557:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa37b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525bc expref: 18 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845464.794585:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd23480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189591296:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845464.794683:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb74ba9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845464.798254:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845464.798271:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd23480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189591296:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845464.798302:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845464.798310:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180164992 00000100:00100000:0.0:1788845464.798319:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180164992 00010000:00010000:0.0:1788845464.798395:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa37b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525bc expref: 19 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845464.798435:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:0.0:1788845464.798447:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+19:2373:x1875740180164992:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845464.798563:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845464.798571:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa37b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525bc expref: 19 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.798585:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa37b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525bc expref: 19 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.798820:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa37b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525bc expref: 19 pid: 5818 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.798841:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:0.0:1788845464.798846:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.798856:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.798896:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.798926:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845464.798970:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845464.798982:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+18:2373:x1875740180164992:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 537us (741us total) trans 0 rc 0/0 00010000:00010000:2.0:1788845464.798985:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845464.798996:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 70 00010000:00010000:2.0:1788845464.799031:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.799040:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.799047:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.799053:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845464.799057:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.799064:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.799073:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:2.0:1788845464.799083:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788845464.799087:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.799094:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845464.799135:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+17:11527:x1875740180164864:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 Request processed in 4729us (5271us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788845464.799143:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 185 00000100:00100000:3.0:1788845464.801667:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845464.801789:0:12028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180165120 00000100:00100000:1.0:1788845464.801800:0:12028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180165120 00000100:00100000:1.0:1788845464.801857:0:12028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:1.0:1788845464.801867:0:12028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+8:2372:x1875740180165120:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788845464.801920:0:12028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.801941:0:12028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.801949:0:12028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788845464.801953:0:12028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845464.801958:0:12028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.801996:0:12028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.802022:0:12028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 8 pid: 6656 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845464.802036:0:12028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12028:1875740189591424:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845464.802128:0:12028:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeae210300 going to sleep for 11 seconds 00000100:00100000:1.0:1788845464.804189:0:12028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12028:1875740189591424:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845464.804447:0:12028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845464.804479:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845464.804559:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180165248 00000100:00100000:2.0:1788845464.804567:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180165248 00010000:00010000:2.0:1788845464.804601:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 9 pid: 6656 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845464.804640:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 71 00000100:00100000:2.0:1788845464.804651:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+9:2373:x1875740180165248:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845464.804665:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845464.804690:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 9 pid: 6656 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.804704:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 9 pid: 6656 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.804743:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfa3a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0x461ce120077525d8 expref: 9 pid: 6656 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.804762:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845464.804781:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845464.804786:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.804796:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.804828:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845464.804906:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180165248:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 257us (427us total) trans 0 rc 0/0 00010000:00010000:3.0:1788845464.804910:0:12028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845464.804916:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 71 00010000:00010000:3.0:1788845464.804925:0:12028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.804952:0:12028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.804962:0:12028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.804970:0:12028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.804977:0:12028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09a00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845464.804982:0:12028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.804992:0:12028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.805017:0:12028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.805026:0:12028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7108c3a/0xd8041b54d6dfa3c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845464.805128:0:12028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180165120:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 Request processed in 3261us (3474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845464.805137:0:12028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:2.0:1788845464.806944:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845464.806989:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180165504 00000100:00100000:3.0:1788845464.806999:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180165504 00000100:00100000:3.0:1788845464.807044:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 186 00000100:00100000:3.0:1788845464.807051:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+17:11527:x1875740180165504:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788845464.807114:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa3c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.807126:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa3c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.807134:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa3c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.807635:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.807662:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa389 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525c3 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.807671:0:7234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.807706:0:7234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525c3 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.807721:0:7234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa389 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525c3 expref: 18 pid: 5817 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845464.807745:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189591552:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845464.807827:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb74ba9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845464.811771:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189591552:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845464.811798:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:2.0:1788845464.811805:0:7234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845464.811965:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180165632 00000100:00100000:3.0:1788845464.811974:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180165632 00010000:00010000:3.0:1788845464.812010:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa389 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525c3 expref: 19 pid: 5817 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845464.812227:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 72 00000100:00100000:3.0:1788845464.812237:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+19:2375:x1875740180165632:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845464.812328:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845464.812337:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa389 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525c3 expref: 19 pid: 5817 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.812421:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525c3 expref: 19 pid: 5817 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.812449:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa389 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525c3 expref: 19 pid: 5817 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.812483:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:3.0:1788845464.812488:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.812496:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.812504:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.812536:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845464.812622:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+18:2375:x1875740180165632:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 386us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845464.812630:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 72 00010000:00010000:0.0:1788845464.812713:0:7234:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845464.812723:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845464.812961:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788845464.813124:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788845464.813188:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788845464.813556:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189591680:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788845464.813630:0:7234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845464.813666:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f71cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845464.813689:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189591680 00000100:00100000:2.0:1788845464.813702:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189591680 00000100:00100000:2.0:1788845464.813793:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788845464.813802:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7234:x1875740189591680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788845464.814684:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7234:x1875740189591680:12345-0@lo:1000:mdt00_003.0 Request processed in 872us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845464.814694:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845464.814763:0:7234:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788845464.814770:0:7234:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92aeadd11500, transno 4294967315 00000100:00100000:1.0:1788845464.814788:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7e29500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189591680:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788845464.817136:0:7234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788845464.817338:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd13100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189591808:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788845464.817715:0:7234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845464.817817:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeae2106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845464.817953:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189591808 00000100:00100000:2.0:1788845464.817961:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189591808 00000100:00100000:2.0:1788845464.818013:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788845464.818089:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7234:x1875740189591808:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788845464.818815:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7234:x1875740189591808:12345-0@lo:1000:mdt00_003.0 Request processed in 791us (1098us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788845464.818824:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845464.818976:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd13100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7234:1875740189591808:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788845464.819018:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819101:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819108:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819113:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845464.819118:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819127:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819161:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:1.0:1788845464.819174:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845464.819179:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819186:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa3cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819231:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa304 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819238:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa304 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819245:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa304 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819619:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1ee00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845464.819622:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa304 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819628:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa304 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819638:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9900) 00010000:00010000:1.0:1788845464.819641:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845464.819644:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa304 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819650:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1ee00/0xd8041b54d6dfa304 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819690:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819705:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525a7 expref: 21 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819713:0:7234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819747:0:7234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525a7 expref: 21 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.819761:0:7234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525a7 expref: 21 pid: 8176 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845464.819774:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd11c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189591936:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845464.819846:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeae2106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845464.823135:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd11c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189591936:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845464.823151:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:1.0:1788845464.823172:0:7234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845464.823204:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180165760 00000100:00100000:3.0:1788845464.823213:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180165760 00010000:00010000:3.0:1788845464.823252:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525a7 expref: 22 pid: 8176 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845464.823406:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:2.0:1788845464.823420:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+22:2372:x1875740180165760:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845464.823435:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845464.823444:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525a7 expref: 22 pid: 8176 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.823457:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525a7 expref: 22 pid: 8176 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.823502:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525a7 expref: 22 pid: 8176 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.823517:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9900) 00010000:00010000:2.0:1788845464.823522:0:6672:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.823530:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.823536:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.823565:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845464.823618:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+21:2372:x1875740180165760:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 202us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845464.823625:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 73 00010000:00010000:1.0:1788845464.823765:0:7234:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823774:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823787:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823800:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823807:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823813:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845464.823818:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823826:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823835:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9900) 00010000:00010000:1.0:1788845464.823838:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845464.823842:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823847:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa3d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823932:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa3c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823941:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa3c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823947:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa3c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823952:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845464.823961:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa3c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823967:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa3c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823975:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9900) 00010000:00010000:1.0:1788845464.823978:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788845464.823981:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa3c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845464.823986:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa3c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788845464.824480:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788845464.824486:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788845464.824699:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+20:11527:x1875740180165504:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 17645us (17766us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788845464.824710:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 186 00000020:00080000:1.0:1788845464.824714:0:7234:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788845464.825946:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788845464.825978:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788845464.828087:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845464.828226:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180166016 00000100:00100000:2.0:1788845464.828236:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180166016 00000100:00100000:2.0:1788845464.828873:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:2.0:1788845464.828896:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+20:11527:x1875740180166016:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788845464.829785:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788845464.829905:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788845464.829950:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa3dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.829966:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa3dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.829989:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa3dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.829998:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa3dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.830005:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa3dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.830011:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa3dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845464.830026:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788845464.830134:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+22:11527:x1875740180166016:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 1240us (2065us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788845464.830142:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00000020:00080000:2.0:1788845464.830147:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788845464.830502:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845464.830511:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa3dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.830520:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845464.830524:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa3dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.830532:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa3dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.830546:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ae931ba200) 00010000:00010000:3.0:1788845464.830549:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788845464.830554:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa3dd lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.830560:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa3dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845464.830577:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845464.830580:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845464.830581:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845465.435777:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788845466.251188:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1788845466.251206:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1788845466.251211:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:0.0:1788845466.306981:0:12519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845466.306992:0:12519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845466.307034:0:12519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788845466.307039:0:12519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788845466.331233:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.331280:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.331314:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.331338:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.331383:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.331413:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180166144 00000100:00100000:2.0:1788845466.331421:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180166144 00000100:00100000:2.0:1788845466.331467:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 281 00000100:00100000:2.0:1788845466.331477:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180166144:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845466.331515:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180166272 00000100:00100000:1.0:1788845466.331522:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180166272 00000100:00100000:2.0:1788845466.331559:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2373:x1875740180166144:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845466.331568:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 281 00000100:00100000:1.0:1788845466.331571:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180166656 00000100:00100000:1.0:1788845466.331576:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180166656 00000100:00100000:2.0:1788845466.331612:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180166528 00000100:00100000:1.0:1788845466.331613:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 121 00000100:00100000:2.0:1788845466.331618:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180166528 00000100:00100000:1.0:1788845466.331626:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+22:2373:x1875740180166272:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845466.331633:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180166400 00000100:00100000:3.0:1788845466.331643:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180166400 00000100:00100000:2.0:1788845466.331655:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:2.0:1788845466.331667:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180166528:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845466.331682:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:3.0:1788845466.331693:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180166400:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845466.331700:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180166528:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 35us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845466.331708:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:3.0:1788845466.331732:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2373:x1875740180166400:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 40us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845466.331736:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:3.0:1788845466.331745:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:2.0:1788845466.331751:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180166656:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845466.331786:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c53707e2-5013-40b9-a38c-51554aa096c9+5:2373:x1875740180166656:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 41us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845466.331802:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+22:2373:x1875740180166272:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 176us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845466.331807:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:1.0:1788845466.331816:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 121 00000100:00080000:1.0:1788845466.331846:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845466.331850:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845466.331853:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845466.382877:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845466.383038:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180166912 00000100:00100000:0.0:1788845466.383049:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180166912 00000100:00100000:0.0:1788845466.383126:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 187 00000100:00100000:0.0:1788845466.383138:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+22:11545:x1875740180166912:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845466.383156:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845466.383176:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa3e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525df expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.383271:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa3eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.383285:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa3eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.383299:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa3eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845466.383310:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788845466.383456:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa3e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525df expref: 25 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.383474:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa3eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525df expref: 24 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.383481:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845466.383484:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788845466.383487:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031600, rc 0) 00000100:00100000:0.0:1788845466.383559:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+24:11545:x1875740180166912:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 424us (711us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788845466.383567:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 187 00000100:00100000:2.0:1788845466.387976:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845466.389217:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180167040 00000100:00100000:0.0:1788845466.389234:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180167040 00000100:00100000:0.0:1788845466.389291:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 188 00000100:00100000:0.0:1788845466.389300:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+24:11545:x1875740180167040:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:0.0:1788845466.389400:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa3f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.389417:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.389427:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.389444:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa400 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.389451:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.389458:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393589:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393612:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393624:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845466.393677:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393704:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393711:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa3f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393719:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393725:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845466.393729:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393736:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa3f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393748:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845466.393751:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845466.393755:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa3f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393761:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa3f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393774:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393781:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa400 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393786:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393797:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845466.393801:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393807:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa400 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393815:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae83de9100) 00010000:00010000:0.0:1788845466.393817:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845466.393820:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa400 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393826:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa400 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393843:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.393849:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa407 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.394158:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.394164:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845466.394166:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.394173:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa407 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.394190:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:0.0:1788845466.394192:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845466.394195:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa407 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.394200:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa407 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845466.394332:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+24:11545:x1875740180167040:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 5027us (6363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845466.394342:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 188 00000100:00100000:0.0:1788845466.435166:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.435320:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180167296 00000100:00100000:2.0:1788845466.435331:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180167296 00000100:00100000:2.0:1788845466.435750:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 189 00000100:00100000:2.0:1788845466.435763:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+24:11548:x1875740180167296:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845466.435784:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845466.435803:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa40e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525e6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.435880:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa415 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.435903:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.435915:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.435932:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa41c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.435940:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa41c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.435947:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa41c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436238:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436247:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436255:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845466.436264:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788845466.436391:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436399:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa415 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436405:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436417:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845466.436422:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436428:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa415 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436440:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:2.0:1788845466.436443:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845466.436446:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa415 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436452:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa415 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436463:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa41c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436469:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa41c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436475:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa41c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436480:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845466.436483:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa41c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436489:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa41c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436507:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae931baf00) 00010000:00010000:2.0:1788845466.436509:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845466.436512:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa41c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436518:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa41c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436559:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa40e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525e6 expref: 27 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436573:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525e6 expref: 26 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.436581:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:2.0:1788845466.436583:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845466.436585:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0a00, rc 0) 00000100:00100000:2.0:1788845466.436645:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+26:11548:x1875740180167296:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 886us (1493us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788845466.436653:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 189 00000100:00100000:1.0:1788845466.438892:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845466.443492:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180167424 00000100:00100000:3.0:1788845466.443530:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180167424 00000100:00100000:3.0:1788845466.443605:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 190 00000100:00100000:3.0:1788845466.443616:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+26:11548:x1875740180167424:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:3.0:1788845466.443682:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.443701:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.443713:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.443745:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.443752:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa431 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.443758:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.443764:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ba00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845466.443768:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.443775:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.443786:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:3.0:1788845466.443789:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788845466.443793:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa431 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.443809:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.443904:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+26:11548:x1875740180167424:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 289us (5033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845466.443912:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 190 00000100:00100000:3.0:1788845466.445794:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.445864:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180167680 00000100:00100000:2.0:1788845466.445885:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180167680 00000100:00100000:2.0:1788845466.445936:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:2.0:1788845466.445945:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+26:11548:x1875740180167680:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:2.0:1788845466.446182:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+27:11548:x1875740180167680:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 237us (396us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788845466.446314:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 51 00010000:00010000:2.0:1788845466.459858:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845466.483919:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845466.484068:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180167936 00000100:00100000:0.0:1788845466.484076:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180167936 00000100:00100000:0.0:1788845466.484145:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 191 00000100:00100000:0.0:1788845466.484156:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+27:11075:x1875740180167936:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1788845466.484180:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845466.484200:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa438 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525ed expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.484299:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.484313:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa423 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525e6 expref: 28 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.484321:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.484407:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525e6 expref: 28 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.484421:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525e6 expref: 28 pid: 5818 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845466.484433:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875740189592064:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845466.484514:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc93e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845466.489056:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5819:1875740189592064:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845466.489089:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.492685:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845466.496583:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180168064 00000100:00100000:1.0:1788845466.496602:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180168064 00010000:00010000:1.0:1788845466.496661:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525e6 expref: 29 pid: 5818 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845466.496718:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:1.0:1788845466.496729:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+29:2372:x1875740180168064:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845466.496744:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845466.496751:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525e6 expref: 29 pid: 5818 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.496763:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525e6 expref: 29 pid: 5818 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.496784:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525e6 expref: 29 pid: 5818 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.496804:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:1.0:1788845466.496809:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.496818:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.496825:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.496858:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845466.496953:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+28:2372:x1875740180168064:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 226us (4281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845466.496961:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 74 00010000:00010000:0.0:1788845466.497662:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.497675:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845466.497703:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788845466.497885:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa438 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525ed expref: 29 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.497905:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525ed expref: 28 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.497914:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:0.0:1788845466.497917:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788845466.497929:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031800, rc 0) 00000100:00100000:0.0:1788845466.497979:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+28:11075:x1875740180167936:12345-192.168.206.35@tcp:101:bash.0 Request processed in 13825us (14073us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788845466.497987:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 191 00000100:00100000:3.0:1788845466.500552:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.501062:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180168320 00000100:00100000:2.0:1788845466.501073:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180168320 00000100:00100000:2.0:1788845466.501215:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 192 00000100:00100000:2.0:1788845466.501226:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+28:11075:x1875740180168320:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:2.0:1788845466.501549:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa44d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.501566:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa44d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.501578:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa44d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845466.501637:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788845466.501664:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d15c8907 reply state 00000000a4a90266 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa44d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845466.501674:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788845466.501724:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788845466.501851:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+32:11075:x1875740180168320:12345-192.168.206.35@tcp:36:bash.0 Request processed in 627us (1320us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788845466.501858:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 192 00000020:00080000:2.0:1788845466.501863:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788845466.508251:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa44d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.508274:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa44d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.508282:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa44d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.508310:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845466.508315:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa44d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.508322:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa44d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.508338:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:2.0:1788845466.508342:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845466.508346:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa44d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.508353:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa44d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.508722:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845466.508910:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180168448 00000100:00100000:1.0:1788845466.508921:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180168448 00000100:00100000:1.0:1788845466.509262:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 193 00000100:00100000:1.0:1788845466.509273:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+31:11075:x1875740180168448:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1788845466.509298:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845466.509315:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa454 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525f4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.509438:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa454 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525f4 expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.509453:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa454 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525f4 expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.509473:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:1.0:1788845466.509476:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845466.509479:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09c00, rc 0) 00000100:00100000:1.0:1788845466.509553:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+32:11075:x1875740180168448:12345-192.168.206.35@tcp:101:bash.0 Request processed in 281us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845466.509559:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 193 00000100:00100000:0.0:1788845466.512625:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.512776:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180168576 00000100:00100000:2.0:1788845466.512789:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180168576 00000100:00100000:2.0:1788845466.512966:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:2.0:1788845466.512976:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:11075:x1875740180168576:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1788845466.512993:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845466.513013:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a669997d/0xd8041b54d6dfa45b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077525fb expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845466.513041:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9d97, atime: 0x6a9f9d96, ctime: 0x6a9f9d97, blocks: 0xb 00010000:00010000:2.0:1788845466.513063:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788845466.513068:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845466.513076:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a669997d/0xd8041b54d6dfa45b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525fb expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.513114:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a669997d/0xd8041b54d6dfa45b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525fb expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.513126:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1c00, rc 0) 00000100:00100000:2.0:1788845466.513199:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+8:11075:x1875740180168576:12345-192.168.206.35@tcp:101:bash.0 Request processed in 225us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845466.513205:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:3.0:1788845466.516149:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845466.516245:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180168704 00000100:00100000:1.0:1788845466.516255:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180168704 00002000:00010000:1.0:1788845466.516293:0:6664:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788845466.516298:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeae043b80 with x1875740180168704 ext(0->18446744073709551615) 00002000:00010000:1.0:1788845466.516309:0:6664:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeae043b80. 00000100:00100000:1.0:1788845466.516503:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:1.0:1788845466.516630:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180168704:12345-192.168.206.35@tcp:10:bash.0 00002000:00010000:1.0:1788845466.517095:0:6664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788845466.517101:0:6664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788845463 -> 1788845465 00002000:00010000:1.0:1788845466.517104:0:6664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788845462 -> 1788845462 00002000:00010000:1.0:1788845466.517106:0:6664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788845463 -> 1788845465 00002000:00010000:1.0:1788845466.517109:0:6664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788845466.517237:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:704fd1fa-8fb6-403c-867f-b875231088ec+9:2373:x1875740180168704:12345-192.168.206.35@tcp:10:bash.0 Request processed in 610us (1098us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788845466.517754:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00002000:00010000:1.0:1788845466.517764:0:6664:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788845466.517767:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeae043b80 with x1875740180168704 ext(0->18446744073709551615) 00002000:00010000:1.0:1788845466.517774:0:6664:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeae043b80. 00000100:00100000:1.0:1788845466.579047:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845466.579168:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180168832 00000100:00100000:0.0:1788845466.579187:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180168832 00000100:00100000:0.0:1788845466.579251:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 194 00000100:00100000:0.0:1788845466.579261:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+32:11562:x1875740180168832:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:0.0:1788845466.579333:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa462 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.579349:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa462 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.579386:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa462 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.579404:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.579412:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.579418:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580146:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa470 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580159:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580190:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845466.580235:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580247:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa462 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580258:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa462 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580265:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa462 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580271:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845466.580276:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa462 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580283:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa462 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580295:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845466.580298:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845466.580302:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa462 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580308:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa462 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580322:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580334:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa469 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580340:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580344:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845466.580347:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580353:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa469 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580423:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae83de9400) 00010000:00010000:0.0:1788845466.580426:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845466.580430:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa469 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580436:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa469 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580453:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580459:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa470 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580464:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580469:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845466.580477:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580484:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa470 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580492:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:0.0:1788845466.580495:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845466.580497:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa470 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.580502:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa470 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845466.580589:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+32:11562:x1875740180168832:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 1327us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845466.580599:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 194 00000100:00100000:0.0:1788845466.611980:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.612245:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180169088 00000100:00100000:2.0:1788845466.612255:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180169088 00000100:00100000:2.0:1788845466.612416:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 195 00000100:00100000:2.0:1788845466.612433:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+32:11565:x1875740180169088:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845466.612453:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845466.612473:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa477 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752602 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.612561:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa47e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.612574:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa47e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.612585:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa47e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.612599:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.612627:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.612634:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.612928:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa48c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.612938:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa48c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.612946:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa48c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845466.612956:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788845466.613055:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa47e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613062:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa47e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613068:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa47e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613074:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845466.613078:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa47e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613085:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa47e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613106:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:2.0:1788845466.613109:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845466.613113:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa47e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613120:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa47e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613132:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613138:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa485 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613143:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613148:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845466.613151:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613156:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa485 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613164:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae931bad00) 00010000:00010000:2.0:1788845466.613166:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845466.613169:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa485 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613175:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613224:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa477 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752602 expref: 35 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613239:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa48c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752602 expref: 34 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.613247:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:2.0:1788845466.613249:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788845466.613252:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0000, rc 0) 00000100:00100000:2.0:1788845466.613317:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+34:11565:x1875740180169088:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 892us (1350us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788845466.613324:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 195 00000100:00100000:3.0:1788845466.618819:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845466.618932:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180169216 00000100:00100000:1.0:1788845466.618942:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180169216 00000100:00100000:1.0:1788845466.619051:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 196 00000100:00100000:1.0:1788845466.619062:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+34:11565:x1875740180169216:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:1.0:1788845466.619126:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.619142:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525ed expref: 34 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.619152:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.619209:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525ed expref: 34 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.619222:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525ed expref: 34 pid: 5819 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845466.619237:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd13480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189592192:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845466.619340:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae833e4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845466.623251:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845466.623443:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd13480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189592192:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845466.623473:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845466.623613:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180169472 00000100:00100000:2.0:1788845466.626131:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180169472 00000100:00100000:2.0:1788845466.626287:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:2.0:1788845466.626298:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+35:5612:x1875740180169472:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788845466.627741:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+36:5612:x1875740180169472:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 1434us (4491us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788845466.627753:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:0.0:1788845466.630753:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845466.630843:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180169600 00000100:00100000:3.0:1788845466.630853:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180169600 00010000:00010000:3.0:1788845466.630903:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525ed expref: 36 pid: 5819 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.631267:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 75 00000100:00100000:3.0:1788845466.631281:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+36:2372:x1875740180169600:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845466.631394:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845466.631403:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525ed expref: 36 pid: 5819 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.631432:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525ed expref: 36 pid: 5819 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.631453:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa43f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077525ed expref: 36 pid: 5819 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.631472:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:3.0:1788845466.631477:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.631486:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.631493:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.631949:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845466.632176:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.632186:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.632220:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.632226:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.632232:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.632237:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845466.632241:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.632249:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.632270:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:1.0:1788845466.632272:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845466.632276:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.632282:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa49a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.632445:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+35:2372:x1875740180169600:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 1165us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845466.632453:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 75 00000100:00100000:1.0:1788845466.633412:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+34:11565:x1875740180169216:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 13951us (14204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845466.633423:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 196 00000100:00100000:0.0:1788845466.636723:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845466.636780:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180169856 00000100:00100000:1.0:1788845466.636790:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180169856 00000100:00100000:1.0:1788845466.637448:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:1.0:1788845466.637461:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+34:11565:x1875740180169856:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:1.0:1788845466.638755:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+35:11565:x1875740180169856:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 1289us (2038us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788845466.638767:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:0.0:1788845466.706194:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845466.706590:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180170112 00000100:00100000:1.0:1788845466.706600:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180170112 00000100:00100000:1.0:1788845466.706652:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 197 00000100:00100000:1.0:1788845466.706662:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+35:11576:x1875740180170112:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:1.0:1788845466.706684:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845466.706704:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa4a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752609 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.706777:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.706810:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.706821:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.706838:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.706846:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.706852:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.707278:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6dfa4b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.707289:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6dfa4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.707298:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6dfa4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845466.707307:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788845466.707518:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.707526:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.707533:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.707546:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845466.707551:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.707558:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.707570:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:1.0:1788845466.707573:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845466.707577:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.708040:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.708057:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.708063:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.708069:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.708075:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845466.708078:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.708085:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.708106:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae93b8ee00) 00010000:00010000:1.0:1788845466.708108:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845466.708111:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.708117:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.708306:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09200/0xd8041b54d6dfa4a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752609 expref: 38 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.708321:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6dfa4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752609 expref: 37 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.708329:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:1.0:1788845466.708332:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845466.708335:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08400, rc 0) 00000100:00100000:1.0:1788845466.708526:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+37:11576:x1875740180170112:12345-192.168.206.35@tcp:101:cat.0 Request processed in 1863us (2344us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788845466.708535:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 197 00000100:00100000:2.0:1788845466.717283:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189592320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845466.717445:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845466.717471:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189592448:0@lo:400:kworker.0 00000100:00100000:1.0:1788845466.717488:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189592320 00000100:00100000:1.0:1788845466.717497:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189592320 00000100:00100000:0.0:1788845466.717517:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788845466.717544:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845466.717655:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189592832:0@lo:400:kworker.0 00000100:00100000:0.0:1788845466.717673:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875740189592704:0@lo:400:kworker.0 00000100:00100000:2.0:1788845466.717690:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845466.717711:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845466.717729:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189592832 00000100:00100000:0.0:1788845466.717739:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845466.717746:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189592576:0@lo:400:kworker.0 00000100:00100000:2.0:1788845466.717750:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189592832 00000100:00100000:0.0:1788845466.717774:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845466.717800:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189592704 00000100:00100000:2.0:1788845466.717804:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189592704 00000100:00100000:0.0:1788845466.717811:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189592576 00000100:00100000:1.0:1788845466.717825:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788845466.717825:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189592576 00000100:00100000:2.0:1788845466.717832:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788845466.717840:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189592320:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845466.717843:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189592832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845466.717860:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788845466.717882:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875740189592704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845466.717925:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875740189592704:12345-0@lo:400:kworker.0 Request processed in 57us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845466.717931:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788845466.717950:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788845466.717957:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189592576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845466.717985:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189592576:12345-0@lo:400:kworker.0 Request processed in 29us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845466.717992:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00002000:00000024:1.0:1788845466.717996:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845466.718020:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189592832:12345-0@lo:400:kworker.0 Request processed in 178us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845466.718028:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788845466.718034:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189592576:0@lo:400:kworker.0 00000100:00100000:1.0:1788845466.718048:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189592320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 212us (603us total) trans 0 rc 0/0 00000100:00080000:2.0:1788845466.718053:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845466.718056:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875740189592704:0@lo:400:kworker.0 00000100:00100000:1.0:1788845466.718070:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788845466.718079:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189592832:0@lo:400:kworker.0 00000100:00100000:2.0:1788845466.718093:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000100:00100000:1.0:1788845466.718097:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189592448 00000004:00080000:2.0:1788845466.718098:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000100:00100000:1.0:1788845466.718103:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189592448 00000004:00080000:2.0:1788845466.718122:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ae8fcbe680, transno 4294967307 00000100:00100000:1.0:1788845466.718139:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788845466.718148:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189592448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845466.718248:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189592320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845466.718469:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189592448:12345-0@lo:400:kworker.0 Request processed in 321us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845466.718476:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788845466.718671:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189592448:0@lo:400:kworker.0 00000100:00100000:0.0:1788845466.718950:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189592960:0@lo:400:kworker.0 00000100:00100000:0.0:1788845466.718985:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845466.719064:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189592960 00000100:00100000:3.0:1788845466.719070:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189592960 00000100:00100000:3.0:1788845466.719124:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788845466.719133:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189592960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845466.719174:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fcbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189592960:12345-0@lo:400:kworker.0 Request processed in 43us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845466.719192:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788845466.719233:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189592960:0@lo:400:kworker.0 00000100:00080000:0.0:1788845466.719340:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845466.719734:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845466.719957:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180170368 00000100:00100000:3.0:1788845466.719962:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180170368 00000100:00100000:3.0:1788845466.720043:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:3.0:1788845466.720052:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+37:11576:x1875740180170368:12345-192.168.206.35@tcp:35:cat.0 00000100:00100000:3.0:1788845466.720282:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+38:11576:x1875740180170368:12345-192.168.206.35@tcp:35:cat.0 Request processed in 231us (550us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788845466.720289:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:0.0:1788845466.741573:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845466.742002:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180170624 00000100:00100000:3.0:1788845466.742012:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180170624 00000100:00100000:3.0:1788845466.742076:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 198 00000100:00100000:3.0:1788845466.742084:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+38:11577:x1875740180170624:12345-192.168.206.35@tcp:36:rm.0 00010000:00010000:3.0:1788845466.742134:0:8176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788845466.742259:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6dfa4b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752609 expref: 38 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.742278:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa48c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752602 expref: 37 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.742288:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa454 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525f4 expref: 36 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.742294:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae931ba100) 00010000:00010000:3.0:1788845466.742301:0:8176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845466.742319:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa4c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.742402:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa4c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.742413:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa4c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.742430:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa4cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.742437:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.742444:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.743911:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa4d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.743926:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa4d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.743935:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa4d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788845466.745035:0:8176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788845466.745047:0:8176:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 275964684368ns, next at 276964681948ns, rc = 0 00010000:00010000:3.0:1788845466.745113:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa4d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.745125:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.745333:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.745344:0:8176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa4d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.745351:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa4d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.745356:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa4d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.746841:0:8176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788845466.746882:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa4d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.746892:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa4d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.746899:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa4d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.746904:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845466.746909:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa4d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.746916:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa4d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.746929:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae90a6f500) 00010000:00010000:3.0:1788845466.746933:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788845466.746952:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa4d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.746959:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa4d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.746982:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa4c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.746988:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa4c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.746994:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa4c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.747000:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ba00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845466.747003:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa4c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.747009:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa4c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.747018:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:3.0:1788845466.747021:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845466.747024:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa4c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.747029:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa4c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845466.747039:0:8176:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029fce464 reply state 000000007f5939b4 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.747059:0:8176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845466.747236:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+37:11577:x1875740180170624:12345-192.168.206.35@tcp:36:rm.0 Request processed in 5147us (5673us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788845466.747246:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 198 00010000:00010000:0.0:1788845466.749413:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845466.749647:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa4d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.749660:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845466.749665:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa4d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.749676:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa4d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.749718:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ae90a6f500) 00010000:00010000:0.0:1788845466.749720:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788845466.749725:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa4d9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.749731:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a600/0xd8041b54d6dfa4d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.749757:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845466.749758:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845466.749760:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845466.751929:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.751949:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa4cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.751956:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa4cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.751962:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845466.751967:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa4cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.751975:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa4cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.751989:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae90a6ff00) 00010000:00010000:0.0:1788845466.751992:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845466.751996:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa4cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.752023:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b800/0xd8041b54d6dfa4cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845466.791183:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845466.791431:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180170880 00000100:00100000:1.0:1788845466.791442:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180170880 00000100:00100000:1.0:1788845466.791506:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 199 00000100:00100000:1.0:1788845466.791523:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+36:11583:x1875740180170880:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1788845466.791565:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845466.791588:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752610 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.791824:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.791854:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.791876:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.791892:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa4ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.791898:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa4ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.791923:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa4ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845466.792781:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788845466.792983:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa4f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.792994:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.793003:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.793034:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.793041:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.793049:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.793055:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845466.793060:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.793068:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.793080:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:1.0:1788845466.793083:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845466.793095:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.793102:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa4e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845466.793118:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bee15e1 reply state 00000000489e4cca transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa4ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845466.793127:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788845466.793156:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa4e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752610 expref: 39 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.793170:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752610 expref: 38 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845466.793178:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:1.0:1788845466.793180:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845466.793183:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09000, rc 0) 00000100:00100000:1.0:1788845466.793252:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+39:11583:x1875740180170880:12345-192.168.206.35@tcp:101:bash.0 Request processed in 1737us (2082us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788845466.793260:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 199 00000100:00100000:1.0:1788845466.797158:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:0.0:1788845466.797354:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa4ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.797405:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa4ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.797413:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa4ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.797421:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845466.797425:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa4ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.797433:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa4ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.797450:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae93b8ee00) 00010000:00010000:0.0:1788845466.797453:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845466.797457:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa4ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.797463:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfa4ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.798043:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180171008 00000100:00100000:3.0:1788845466.798054:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180171008 00000100:00100000:3.0:1788845466.798106:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:3.0:1788845466.798117:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2372:x1875740180171008:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1788845466.798134:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845466.798152:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079d1ee89/0xd8041b54d6dfa503 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752617 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845466.798181:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845466.798200:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=276s v=(0 0) 00010000:00010000:3.0:1788845466.798211:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845466.798218:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079d1ee89/0xd8041b54d6dfa503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752617 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.798232:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079d1ee89/0xd8041b54d6dfa503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752617 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.798241:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748ba00, rc 0) 00000100:00100000:3.0:1788845466.798293:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180171008:12345-192.168.206.35@tcp:101:bash.0 Request processed in 179us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845466.798300:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:2.0:1788845466.800343:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845466.800494:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180171136 00000100:00100000:3.0:1788845466.800502:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180171136 00000100:00100000:3.0:1788845466.800771:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:3.0:1788845466.800782:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+6:11583:x1875740180171136:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1788845466.800799:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845466.800815:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775261e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.800845:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079d1ee89/0xd8041b54d6dfa503 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752617 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.800853:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845466.800857:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845466.800862:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.800909:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079d1ee89/0xd8041b54d6dfa503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752617 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.800922:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079d1ee89/0xd8041b54d6dfa503 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752617 expref: 7 pid: 6658 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.800935:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6659:1875740189593088:192.168.206.35@tcp:104: 00000100:00100000:3.0:1788845466.801019:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fd8b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845466.804909:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.805455:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180171264 00000100:00100000:2.0:1788845466.805465:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180171264 00010000:00010000:2.0:1788845466.805508:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079d1ee89/0xd8041b54d6dfa503 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752617 expref: 8 pid: 6658 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845466.805553:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:2.0:1788845466.805563:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180171264:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845466.805578:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845466.805604:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079d1ee89/0xd8041b54d6dfa503 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752617 expref: 8 pid: 6658 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.805636:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079d1ee89/0xd8041b54d6dfa503 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752617 expref: 8 pid: 6658 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.805672:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845466.805677:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845466.805685:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.805695:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.805733:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845466.805748:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd21500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5803:1875740189593216:192.168.206.35@tcp:105: 00000100:00100000:2.0:1788845466.805831:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae82f03b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788845466.806249:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079d1ee89/0xd8041b54d6dfa503 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752617 expref: 8 pid: 6658 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.806279:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6659:1875740189593088:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845466.806303:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.806314:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b400, rc 0) 00000100:00100000:3.0:1788845466.806357:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+7:11583:x1875740180171136:12345-192.168.206.35@tcp:101:bash.0 Request processed in 5577us (6024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845466.806401:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:2.0:1788845466.808736:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd21500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5803:1875740189593216:192.168.206.35@tcp:105: 00010000:00010000:2.0:1788845466.808765:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845466.808860:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2373:x1875740180171264:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 3297us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845466.808884:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:1.0:1788845466.810770:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845466.810845:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180171520 00000100:00100000:0.0:1788845466.810882:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180171520 00000100:00100000:0.0:1788845466.810971:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:0.0:1788845466.811097:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+38:11583:x1875740180171520:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:0.0:1788845466.811521:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+39:11583:x1875740180171520:12345-192.168.206.35@tcp:35:bash.0 Request processed in 427us (761us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788845466.811538:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:0.0:1788845466.845491:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845466.845554:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845466.845662:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180171776 00000100:00100000:1.0:1788845466.845672:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180171776 00000100:00100000:1.0:1788845466.845728:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:1.0:1788845466.845739:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180171776:12345-192.168.206.35@tcp:16:kworker.0 00000100:00100000:1.0:1788845466.845876:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180171776:12345-192.168.206.35@tcp:16:kworker.0 Request processed in 130us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845466.845901:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:3.0:1788845466.846022:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180171648 00000100:00100000:3.0:1788845466.846028:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180171648 00002000:00100000:3.0:1788845466.846055:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff92ae90c42300 x1875740180171648/t0(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:572/0 lens 504/0 e 0 to 0 dl 1788845477 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845466.846065:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ae90c42300 with x1875740180171648 ext(0->8) 00002000:00010000:3.0:1788845466.846070:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ae90c42300 00000100:00100000:3.0:1788845466.846095:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:3.0:1788845466.846102:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:704fd1fa-8fb6-403c-867f-b875231088ec+6:2372:x1875740180171648:12345-192.168.206.35@tcp:4:bash.0 00000100:00100000:3.0:1788845466.846625:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:704fd1fa-8fb6-403c-867f-b875231088ec+8:2372:x1875740180171648:12345-192.168.206.35@tcp:4:bash.0 Request processed in 522us (1146us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788845466.846641:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00002000:00100000:3.0:1788845466.846648:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff92ae90c42300 x1875740180171648/t4294967308(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:572/0 lens 504/448 e 0 to 0 dl 1788845477 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845466.846656:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ae90c42300 with x1875740180171648 ext(0->8) 00002000:00010000:3.0:1788845466.846666:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ae90c42300 00000100:00100000:3.0:1788845466.935861:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845466.935961:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180171904 00000100:00100000:0.0:1788845466.935973:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180171904 00000100:00100000:0.0:1788845466.936047:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 200 00000100:00100000:0.0:1788845466.936058:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+39:11599:x1875740180171904:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845466.936080:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845466.936112:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752625 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.936177:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.936191:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.936202:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845466.936240:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788845466.936244:0:7234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845466.936262:0:7234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.936313:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752625 expref: 41 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.936333:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752625 expref: 40 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.936342:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845466.936344:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845466.936347:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030200, rc 0) 00000100:00100000:0.0:1788845466.936463:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+40:11599:x1875740180171904:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 406us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845466.936470:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 200 00000100:00100000:0.0:1788845466.943980:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845466.944328:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180172160 00000100:00100000:3.0:1788845466.944339:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180172160 00000100:00100000:3.0:1788845466.944516:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 201 00000100:00100000:3.0:1788845466.944536:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+40:11599:x1875740180172160:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1788845466.944556:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845466.944575:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa51f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775262c expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.944686:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa526 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.944708:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.944719:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845466.944730:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788845466.944891:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa51f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775262c expref: 43 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.944911:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775262c expref: 42 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.944919:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:3.0:1788845466.944922:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845466.944925:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b000, rc 0) 00000100:00100000:3.0:1788845466.945012:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+42:11599:x1875740180172160:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 487us (1046us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788845466.945019:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 201 00000100:00100000:1.0:1788845466.950777:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845466.950830:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845466.950920:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180172544 00000100:00100000:3.0:1788845466.950931:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180172544 00000100:00100000:3.0:1788845466.950991:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:3.0:1788845466.950998:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+42:2373:x1875740180172544:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845466.951010:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845466.951029:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa526 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775262c expref: 42 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.951043:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:3.0:1788845466.951047:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845466.951084:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+41:2373:x1875740180172544:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 87us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845466.951088:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:0.0:1788845466.951244:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180172416 00000100:00100000:0.0:1788845466.951249:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180172416 00000100:00100000:0.0:1788845466.951292:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 202 00000100:00100000:0.0:1788845466.951300:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+41:11599:x1875740180172416:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845466.951318:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845466.951333:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa534 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752633 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.951453:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa53b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.951466:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa53b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.951502:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa53b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845466.951514:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788845466.951649:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa534 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752633 expref: 44 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.951665:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa53b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752633 expref: 43 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.951673:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:0.0:1788845466.951676:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788845466.951679:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030600, rc 0) 00000100:00100000:0.0:1788845466.951724:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+43:11599:x1875740180172416:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 425us (962us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788845466.951731:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 202 00000100:00100000:1.0:1788845466.959473:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845466.959783:0:12028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180172672 00000100:00100000:3.0:1788845466.959792:0:12028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180172672 00000100:00100000:3.0:1788845466.959854:0:12028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:3.0:1788845466.959875:0:12028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+8:2375:x1875740180172672:12345-192.168.206.35@tcp:1:lfs.0 00010000:00010000:3.0:1788845466.959920:0:12028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.959941:0:12028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.959950:0:12028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845466.959972:0:12028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845466.959977:0:12028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.960017:0:12028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.960038:0:12028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 8 pid: 6659 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.960053:0:12028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae041500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12028:1875740189593344:192.168.206.35@tcp:104: 00000100:00100000:3.0:1788845466.960159:0:12028:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fd8b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845466.962948:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.963170:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180172800 00000100:00100000:2.0:1788845466.963179:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180172800 00010000:00010000:2.0:1788845466.963214:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 9 pid: 6659 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845466.963275:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 77 00000100:00100000:2.0:1788845466.963285:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+9:2373:x1875740180172800:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845466.963299:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788845466.963319:0:8419:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788845466.963323:0:8419:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788845466 00002000:00010000:2.0:1788845466.963325:0:8419:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788845466 00010000:00010000:2.0:1788845466.963332:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 9 pid: 6659 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.963346:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 9 pid: 6659 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.963392:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845466.963397:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845466.963402:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.963413:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.963433:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845466.963508:0:12028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006789187e/0xd8041b54d6dfa50a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775261e expref: 9 pid: 6659 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.963525:0:12028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae041500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12028:1875740189593344:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845466.963609:0:12028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.963620:0:12028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.963627:0:12028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.963713:0:12028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.963729:0:12028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.963736:0:12028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.963743:0:12028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845466.963747:0:12028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.963756:0:12028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.963769:0:12028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845466.963776:0:12028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa549 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845466.963903:0:12028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+8:2375:x1875740180172672:12345-192.168.206.35@tcp:1:lfs.0 Request processed in 4039us (4443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845466.963912:0:12028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:2.0:1788845466.964013:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180172800:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 729us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845466.964022:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 77 00000100:00100000:0.0:1788845466.965728:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845466.965846:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180173056 00000100:00100000:3.0:1788845466.965856:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180173056 00000100:00100000:3.0:1788845466.965921:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:3.0:1788845466.965947:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+43:11599:x1875740180173056:12345-192.168.206.35@tcp:35:lfs.0 00000004:00010000:3.0:1788845466.966006:0:5820:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa53b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752633 expref: 43 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845466.966560:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788845466.966610:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788845466.968063:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788845466.968156:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.968240:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa4f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752610 expref: 47 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.968249:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.968287:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752610 expref: 47 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.968304:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752610 expref: 47 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845466.968318:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd21500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5820:1875740189593472:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845466.970223:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae82f03240 going to sleep for 11 seconds 00000100:00100000:2.0:1788845466.973060:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd21500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5820:1875740189593472:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845466.973092:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845466.973481:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.973582:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180173184 00000100:00100000:2.0:1788845466.973752:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180173184 00010000:00010000:2.0:1788845466.973792:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752610 expref: 48 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845466.973833:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:2.0:1788845466.973842:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+48:2372:x1875740180173184:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845466.973886:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845466.973894:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752610 expref: 48 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.973906:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752610 expref: 48 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.973925:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa4f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752610 expref: 48 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.973942:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:2.0:1788845466.973948:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.973957:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.973965:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.973994:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845466.974047:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+47:2372:x1875740180173184:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 206us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845466.974055:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 78 00010000:00010000:0.0:1788845466.974101:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.974109:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845466.974297:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788845466.974954:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788845466.975082:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189593600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788845466.975141:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845466.975192:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc93e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845466.975254:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189593600 00000100:00100000:2.0:1788845466.975261:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189593600 00000100:00100000:2.0:1788845466.975357:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788845466.975490:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1875740189593600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788845466.975561:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1875740189593600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845466.975575:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845466.975755:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189593600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788845466.976414:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788845466.976485:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b7a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189593728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788845466.976541:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845466.976569:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc93e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845466.977026:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189593728 00000100:00100000:1.0:1788845466.977033:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189593728 00000100:00100000:1.0:1788845466.977467:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788845466.977480:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1875740189593728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788845466.977725:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5820:x1875740189593728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 248us (1182us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788845466.977733:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845466.977810:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b7a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5820:1875740189593728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788845466.977884:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788845466.977931:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.977943:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.977951:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.977957:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845466.977962:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.977975:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.977991:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:0.0:1788845466.977995:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788845466.978000:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845466.978006:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa550 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788845466.978232:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788845466.978333:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788845466.978344:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 276197981067ns, next at 277197978992ns, rc = 0 00000001:00080000:0.0:1788845466.978351:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788845466.979911:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae93b8e300) 00010000:00010000:0.0:1788845466.979920:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788845466.979930:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa53b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752633 expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845466.980062:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+50:11599:x1875740180173056:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 14116us (14347us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788845466.980072:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 56 00000020:00080000:0.0:1788845466.980077:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788845466.987153:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845466.987835:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180173312 00000100:00100000:2.0:1788845466.987847:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180173312 00000100:00100000:2.0:1788845466.987922:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 203 00000100:00100000:2.0:1788845466.987932:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+50:11599:x1875740180173312:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845466.987956:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845466.987976:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa557 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775263a expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.988159:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa557 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775263a expref: 51 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.988175:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa557 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775263a expref: 51 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845466.988193:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:2.0:1788845466.988196:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788845466.988199:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0a00, rc 0) 00000100:00100000:2.0:1788845466.988261:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+51:11599:x1875740180173312:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 330us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845466.988335:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 203 00000100:00100000:2.0:1788845466.992269:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845466.992417:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180173568 00000100:00100000:0.0:1788845466.992428:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180173568 00000100:00100000:0.0:1788845466.992490:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:0.0:1788845466.992501:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+51:11599:x1875740180173568:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845466.992756:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+52:11599:x1875740180173568:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 256us (502us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788845466.992777:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:1.0:1788845467.089805:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845467.090168:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180173696 00000100:00100000:3.0:1788845467.090186:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180173696 00000100:00100000:3.0:1788845467.090349:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 204 00000100:00100000:3.0:1788845467.090390:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+52:11609:x1875740180173696:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:3.0:1788845467.090470:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa55e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090488:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa55e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090500:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa55e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090515:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa565 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090521:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090527:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090696:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa56c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090737:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa56c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090745:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa56c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845467.090790:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa56c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090805:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa55e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090812:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa55e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090819:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa55e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090826:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845467.090831:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa55e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090839:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa55e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090850:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:3.0:1788845467.090872:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845467.090877:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa55e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090884:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa55e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090917:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090923:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa565 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090930:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090935:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845467.090938:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090946:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa565 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090954:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae90a6f900) 00010000:00010000:3.0:1788845467.090956:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845467.090959:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa565 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090964:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa565 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090978:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa56c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090984:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa56c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.090990:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa56c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.091002:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ba00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845467.091005:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa56c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.091011:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa56c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.091019:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:3.0:1788845467.091021:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845467.091024:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa56c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.091029:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa56c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845467.091110:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+52:11609:x1875740180173696:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 751us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845467.091118:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 204 00000100:00100000:1.0:1788845467.142598:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845467.142747:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180173952 00000100:00100000:3.0:1788845467.142758:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180173952 00000100:00100000:3.0:1788845467.142834:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 205 00000100:00100000:3.0:1788845467.142844:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+52:11612:x1875740180173952:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1788845467.142871:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845467.142891:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa573 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752641 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.142967:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa57a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143003:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa57a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143247:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa57a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143264:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143272:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143278:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143446:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa588 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143456:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143463:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845467.143473:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788845467.143755:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa57a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143764:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa57a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143771:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa57a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143785:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845467.143790:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa57a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143798:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa57a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143810:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:3.0:1788845467.143813:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845467.143817:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa57a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143824:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa57a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143839:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143845:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa581 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143852:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143857:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845467.143860:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143878:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa581 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143897:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae90a6f900) 00010000:00010000:3.0:1788845467.143900:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845467.143903:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa581 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143909:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa581 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143951:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa573 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752641 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143964:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752641 expref: 54 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.143971:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:3.0:1788845467.143974:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845467.143976:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a800, rc 0) 00000100:00100000:3.0:1788845467.144312:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+54:11612:x1875740180173952:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1468us (3263us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788845467.144320:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 205 00000100:00100000:2.0:1788845467.154205:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845467.154930:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180174080 00000100:00100000:0.0:1788845467.154943:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180174080 00000100:00100000:0.0:1788845467.155127:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 206 00000100:00100000:0.0:1788845467.155139:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+54:11612:x1875740180174080:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:0.0:1788845467.155208:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa596 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.155243:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.155254:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.155474:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.155481:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa596 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.155488:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.155494:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845467.155500:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.155506:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa596 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.155518:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:0.0:1788845467.155521:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845467.155524:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa596 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.155599:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa596 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845467.155693:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+54:11612:x1875740180174080:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 555us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845467.155708:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 206 00000100:00100000:1.0:1788845467.158026:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845467.158110:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180174336 00000100:00100000:0.0:1788845467.158120:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180174336 00000100:00100000:0.0:1788845467.158177:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:0.0:1788845467.158185:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+54:11612:x1875740180174336:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845467.158495:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+55:11612:x1875740180174336:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 310us (481us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788845467.158503:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:0.0:1788845467.227790:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189593856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845467.227878:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845467.228748:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189593856 00000100:00100000:1.0:1788845467.228761:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189593856 00000100:00100000:1.0:1788845467.228830:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788845467.228840:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875740189593856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845467.228887:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845467.229018:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875740189593856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845467.229026:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788845467.229114:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189593856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845467.229227:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845467.229296:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180174592 00000100:00100000:3.0:1788845467.229301:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180174592 00000100:00100000:3.0:1788845467.229332:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 207 00000100:00100000:3.0:1788845467.229340:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+55:11622:x1875740180174592:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1788845467.229355:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845467.229393:0:8176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788845467.229419:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752625 expref: 55 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.229455:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:3.0:1788845467.229459:0:8176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845467.229472:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa59d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752648 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.229564:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.229578:0:8176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa588 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752641 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.229586:0:8176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.229614:0:8176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752641 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.229626:0:8176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa588 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752641 expref: 55 pid: 5818 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845467.229638:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae041180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189593984:192.168.206.35@tcp:104: 00000100:00100000:3.0:1788845467.229705:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb74ba240 going to sleep for 11 seconds 00000100:00100000:1.0:1788845467.233278:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845467.233425:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180174720 00000100:00100000:3.0:1788845467.233434:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180174720 00010000:00010000:3.0:1788845467.233555:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa588 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752641 expref: 56 pid: 5818 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845467.233666:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:3.0:1788845467.233678:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+56:2372:x1875740180174720:12345-192.168.206.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788845467.233686:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae041180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189593984:192.168.206.35@tcp:104: 00010000:00010000:3.0:1788845467.233692:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845467.233729:0:8176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.233839:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa588 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752641 expref: 56 pid: 5818 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.233852:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752641 expref: 56 pid: 5818 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.233883:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa588 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752641 expref: 56 pid: 5818 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.233902:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:3.0:1788845467.233907:0:6672:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.233916:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.233923:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.233950:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845467.233998:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+55:2372:x1875740180174720:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 323us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845467.234006:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 79 00010000:00010000:2.0:1788845467.234060:0:8176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.234069:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845467.234088:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788845467.234257:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ba00/0xd8041b54d6dfa59d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752648 expref: 56 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.234274:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752648 expref: 55 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.234283:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:2.0:1788845467.234286:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788845467.234288:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b000, rc 0) 00000100:00100000:2.0:1788845467.234315:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+55:11622:x1875740180174592:12345-192.168.206.35@tcp:101:bash.0 Request processed in 4976us (5091us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788845467.234323:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 207 00000100:00100000:3.0:1788845467.238790:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845467.240138:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180174976 00000100:00100000:0.0:1788845467.240151:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180174976 00000100:00100000:0.0:1788845467.240223:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 208 00000100:00100000:0.0:1788845467.240234:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+55:11622:x1875740180174976:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:0.0:1788845467.240623:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.240651:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.240665:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845467.240781:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788845467.240810:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad7c0bcd reply state 00000000c88f275f transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845467.240835:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845467.240949:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+58:11622:x1875740180174976:12345-192.168.206.35@tcp:36:bash.0 Request processed in 716us (2171us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788845467.240957:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 208 00000020:00080000:0.0:1788845467.240962:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788845467.243399:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845467.243640:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180175104 00000100:00100000:2.0:1788845467.243649:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180175104 00000100:00100000:2.0:1788845467.243707:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 209 00000100:00100000:2.0:1788845467.243718:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+58:11622:x1875740180175104:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1788845467.243740:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845467.243760:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa5b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775264f expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.243874:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.243889:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752648 expref: 59 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.243896:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.243902:0:7234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.243921:0:7234:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.243948:0:7234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752648 expref: 59 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.243962:0:7234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752648 expref: 59 pid: 8176 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845467.243976:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae306680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189594112:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845467.244058:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae82f03180 going to sleep for 11 seconds 00010000:00010000:0.0:1788845467.244074:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.244084:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.244091:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.244097:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845467.244101:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.244108:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.244123:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:0.0:1788845467.244126:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845467.244128:0:3270:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.244136:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.244143:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845467.247777:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845467.247789:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae306680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189594112:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845467.247818:0:7234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845467.247966:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180175232 00000100:00100000:3.0:1788845467.247974:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180175232 00010000:00010000:3.0:1788845467.248010:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752648 expref: 59 pid: 8176 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845467.248063:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 80 00000100:00100000:3.0:1788845467.248073:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+59:2372:x1875740180175232:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845467.248088:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845467.248094:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752648 expref: 59 pid: 8176 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.248106:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752648 expref: 59 pid: 8176 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.248124:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa5a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752648 expref: 59 pid: 8176 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.248136:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:3.0:1788845467.248140:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.248149:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.248155:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.248227:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845467.248273:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+58:2372:x1875740180175232:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 202us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845467.248298:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 80 00010000:00010000:0.0:1788845467.248570:0:7234:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.248579:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845467.248624:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788845467.248629:0:7234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845467.248647:0:7234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.248677:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa5b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775264f expref: 58 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.248692:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775264f expref: 57 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.248698:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:0.0:1788845467.248701:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845467.248703:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1800, rc 0) 00000100:00100000:0.0:1788845467.248804:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+57:11622:x1875740180175104:12345-192.168.206.35@tcp:101:bash.0 Request processed in 5088us (5450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845467.248811:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 209 00000100:00100000:2.0:1788845467.254467:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845467.254518:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180175488 00000100:00100000:0.0:1788845467.254600:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180175488 00000100:00100000:0.0:1788845467.254774:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:0.0:1788845467.254786:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+57:11622:x1875740180175488:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:0.0:1788845467.255057:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+58:11622:x1875740180175488:12345-192.168.206.35@tcp:35:bash.0 Request processed in 274us (601us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788845467.255065:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:1.0:1788845467.316620:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845467.316743:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180175616 00000100:00100000:2.0:1788845467.316754:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180175616 00000100:00100000:2.0:1788845467.316850:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 210 00000100:00100000:2.0:1788845467.316887:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+58:11628:x1875740180175616:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845467.316911:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845467.316929:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa5c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752656 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.316991:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa5ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.317004:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.317014:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845467.317048:0:8176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788845467.317051:0:8176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845467.317080:0:8176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.317102:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa5c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752656 expref: 60 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.317119:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa5ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752656 expref: 59 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.317126:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:2.0:1788845467.317129:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845467.317132:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0000, rc 0) 00000100:00100000:2.0:1788845467.317204:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+59:11628:x1875740180175616:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 319us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845467.317220:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 210 00000100:00100000:1.0:1788845467.323277:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845467.323617:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180175744 00000100:00100000:0.0:1788845467.323626:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180175744 00000100:00100000:0.0:1788845467.323690:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 211 00000100:00100000:0.0:1788845467.323701:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+59:11628:x1875740180175744:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845467.323720:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845467.324208:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775265d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324304:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa5dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324318:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa5dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324329:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa5dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324344:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324351:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324358:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324510:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324518:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324525:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845467.324559:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788845467.324563:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845467.324578:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324590:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324598:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa5dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324604:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa5dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324610:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa5dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324616:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845467.324620:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa5dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324627:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa5dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324644:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:0.0:1788845467.324647:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845467.324652:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa5dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324658:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa5dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324674:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324679:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324683:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324688:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845467.324690:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324696:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324703:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae83de9400) 00010000:00010000:0.0:1788845467.324705:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845467.324707:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.324712:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.326447:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775265d expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.326981:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775265d expref: 60 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.326992:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:0.0:1788845467.326995:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845467.326998:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845467.327132:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+60:11628:x1875740180175744:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 3432us (3867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845467.327140:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 211 00000100:00100000:3.0:1788845467.337075:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845467.337125:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845467.337235:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180176128 00000100:00100000:0.0:1788845467.337244:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180176128 00000100:00100000:0.0:1788845467.337309:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 212 00000100:00100000:0.0:1788845467.337320:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+60:11628:x1875740180176128:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845467.337339:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845467.337357:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752664 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.337495:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.337509:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775264f expref: 61 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.337517:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775265d expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.337541:0:7234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.337576:0:7234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775265d expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.337590:0:7234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775265d expref: 61 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845467.337604:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189594240:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845467.337698:0:7234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775264f expref: 61 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.337708:0:7234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775264f expref: 61 pid: 7234 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845467.337718:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189594368:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845467.337743:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98f17840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845467.338395:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180175872 00000100:00100000:2.0:1788845467.338403:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180175872 00010000:00010000:2.0:1788845467.338430:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775265d expref: 62 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845467.338466:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 81 00000100:00100000:2.0:1788845467.338475:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e843450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+62:2372:x1875740180175872:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845467.338485:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845467.338492:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775265d expref: 62 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.338503:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775265d expref: 62 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.338522:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:2.0:1788845467.338527:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.338535:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.338541:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845467.338590:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e843450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+62:2372:x1875740180175872:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 116us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845467.338596:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 81 00010000:00010000:0.0:1788845467.340473:0:7234:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.35@tcp) returned -22 from blocking AST (req@000000002d81513f x1875740189594240) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775265d expref: 61 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.340496:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa5ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775265d expref: 61 pid: 5817 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845467.340514:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189594240:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845467.340546:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189594368:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845467.340575:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:0.0:1788845467.340580:0:7234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.340589:0:7234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.340598:0:7234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845467.340649:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845467.340801:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180176256 00000100:00100000:3.0:1788845467.340808:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180176256 00010000:00010000:3.0:1788845467.340839:0:6672:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775264f expref: 61 pid: 7234 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845467.340894:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 82 00000100:00100000:3.0:1788845467.340904:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+61:2373:x1875740180176256:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845467.340915:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845467.340920:0:6672:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775264f expref: 61 pid: 7234 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.340942:0:6672:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775264f expref: 61 pid: 7234 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.340958:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa5c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775264f expref: 61 pid: 7234 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.340969:0:6672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:3.0:1788845467.340972:0:6672:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.340980:0:6672:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.340987:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.341017:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845467.341060:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:704fd1fa-8fb6-403c-867f-b875231088ec+60:2373:x1875740180176256:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 158us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845467.341067:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 82 00010000:00010000:0.0:1788845467.341315:0:7234:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.341324:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845467.341341:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788845467.341532:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa5f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752664 expref: 61 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.341549:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752664 expref: 60 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.341556:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:0.0:1788845467.341559:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788845467.341562:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030600, rc 0) 00000100:00100000:0.0:1788845467.341685:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+60:11628:x1875740180176128:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 4367us (4558us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788845467.341706:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 212 00000100:00100000:1.0:1788845467.346420:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845467.346510:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180176512 00000100:00100000:2.0:1788845467.346537:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180176512 00000100:00100000:2.0:1788845467.346600:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:2.0:1788845467.346610:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+60:11628:x1875740180176512:12345-192.168.206.35@tcp:103:lfs.0 00010000:00010000:2.0:1788845467.346625:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845467.346648:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa557 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775263a expref: 60 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.346667:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:2.0:1788845467.346672:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845467.346728:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+59:11628:x1875740180176512:12345-192.168.206.35@tcp:103:lfs.0 Request processed in 119us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845467.346736:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:3.0:1788845467.348931:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845467.349046:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180176640 00000100:00100000:2.0:1788845467.349056:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180176640 00000100:00100000:2.0:1788845467.349119:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 213 00000100:00100000:2.0:1788845467.349129:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+59:11628:x1875740180176640:12345-192.168.206.35@tcp:58:lfs.0 00010000:00010000:2.0:1788845467.349269:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.349291:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.349302:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788845467.349673:0:8176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788845467.349871:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+59:11628:x1875740180176640:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 733us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845467.349880:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 213 00000100:00100000:3.0:1788845467.353325:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845467.354028:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180176768 00000100:00100000:0.0:1788845467.354040:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180176768 00000100:00100000:0.0:1788845467.354107:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 214 00000100:00100000:0.0:1788845467.354118:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+59:11628:x1875740180176768:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845467.354136:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845467.354155:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa60d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775266b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.354215:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.354225:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa60d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775266b expref: 60 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.354248:0:5817:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.354260:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa60d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775266b expref: 60 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.354273:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:0.0:1788845467.354276:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788845467.354279:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa60d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775266b expref: 60 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.354286:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031800, rc 0) 00000100:00100000:0.0:1788845467.354959:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+60:11628:x1875740180176768:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 838us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845467.354969:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 214 00010000:00010000:3.0:1788845467.483849:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788845467.931655:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845467.931667:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788845467.931737:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:1.0:1788845467.931744:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788845467.931896:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189594496:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788845467.932001:0:11641:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae93a9b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845467.937974:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189594496:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788845467.939471:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845467.939553:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180176896 00000100:00100000:0.0:1788845467.939564:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180176896 00000100:00100000:0.0:1788845467.939640:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 215 00000100:00100000:0.0:1788845467.939652:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+60:11630:x1875740180176896:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788845467.939685:0:7234:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788845467.939808:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+60:11630:x1875740180176896:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 159us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845467.939816:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 215 00000100:00100000:3.0:1788845467.944501:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845467.945306:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180177024 00000100:00100000:1.0:1788845467.945318:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180177024 00000100:00100000:1.0:1788845467.945512:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 216 00000100:00100000:1.0:1788845467.945536:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+60:11630:x1875740180177024:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788845467.945612:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa614 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945629:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa614 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945651:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa614 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945668:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa61b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945675:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa61b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945706:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa61b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945733:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa622 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945741:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945747:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845467.945789:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788845467.945792:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845467.945806:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945829:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa614 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945834:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa614 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945840:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa614 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945846:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845467.945850:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa614 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945866:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa614 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945885:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:1.0:1788845467.945888:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845467.945894:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa614 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945900:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09000/0xd8041b54d6dfa614 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945917:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa61b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945923:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa61b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945928:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa61b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945933:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845467.945935:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa61b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945942:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa61b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945949:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff92ae93b8e700) 00010000:00010000:1.0:1788845467.945951:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845467.945954:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa61b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945959:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfa61b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945984:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945990:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa622 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.945996:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.946001:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845467.946004:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.946009:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa622 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.946017:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:1.0:1788845467.946019:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845467.946022:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa622 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845467.946027:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09400/0xd8041b54d6dfa622 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845467.946107:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+60:11630:x1875740180177024:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 Request processed in 584us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845467.946115:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 216 00000100:00100000:1.0:1788845467.950042:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845467.950163:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180177280 00000100:00100000:3.0:1788845467.950183:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180177280 00000100:00100000:3.0:1788845467.950256:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 217 00000100:00100000:3.0:1788845467.950266:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+60:11630:x1875740180177280:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845467.950286:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845467.950305:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa629 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752672 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.950679:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa630 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.950695:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.950704:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845467.950715:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788845467.951135:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.951155:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa630 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.951161:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa630 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.951167:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845467.951289:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa630 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.951297:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa630 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.951310:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:3.0:1788845467.951313:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788845467.951317:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa630 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.951324:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa630 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.951530:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa629 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752672 expref: 62 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.951541:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:3.0:1788845467.951544:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788845467.951547:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa629 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752672 expref: 62 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.951558:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a800, rc 0) 00000100:00100000:3.0:1788845467.952483:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+61:11630:x1875740180177280:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 1367us (1614us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788845467.952498:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 217 00000100:00100000:2.0:1788845467.956025:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845467.956103:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180177408 00000100:00100000:3.0:1788845467.956113:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180177408 00000100:00100000:3.0:1788845467.956179:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 218 00000100:00100000:3.0:1788845467.956189:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae90c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+61:11630:x1875740180177408:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788845467.956293:0:8176:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788845467.957065:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae90c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+61:11630:x1875740180177408:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 871us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845467.957074:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 218 00000100:00100000:1.0:1788845467.961791:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845467.962094:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180177664 00000100:00100000:2.0:1788845467.962104:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180177664 00000100:00100000:2.0:1788845467.962180:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 219 00000100:00100000:2.0:1788845467.962191:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+61:11630:x1875740180177664:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845467.962212:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845467.962215:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788845467.962240:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa5ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752656 expref: 61 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845467.962261:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:2.0:1788845467.962266:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845467.962278:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa63e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752679 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788845467.963102:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1788845467.965176:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa645 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.965202:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.965215:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.966003:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1400/0xd8041b54d6dfa63e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752679 expref: 63 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.966031:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752679 expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.966040:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f900) 00010000:00010000:0.0:1788845467.966042:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845467.966045:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a800, rc 0) 00000100:00100000:0.0:1788845467.966153:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+62:11630:x1875740180177664:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 3963us (4372us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788845467.966162:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 219 00000100:00100000:1.0:1788845467.973980:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845467.974078:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180177920 00000100:00100000:3.0:1788845467.974087:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180177920 00000100:00100000:3.0:1788845467.974168:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 220 00000100:00100000:3.0:1788845467.974188:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+62:11630:x1875740180177920:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788845467.974244:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845467.974270:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa645 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752679 expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974303:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f900) 00010000:00010000:3.0:1788845467.974314:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845467.974335:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa653 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974348:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa653 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974357:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa653 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974418:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa65a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xea60297 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974427:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xea60297 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974434:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xea60297 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974910:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa653 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974919:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa653 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974925:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa653 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974931:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845467.974936:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa653 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974951:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa653 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974961:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:3.0:1788845467.974964:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845467.974968:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa653 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974974:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b000/0xd8041b54d6dfa653 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974985:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xea60297 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974991:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa65a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xea60297 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.974996:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa65a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xea60297 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.975001:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845467.975003:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa65a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xea60297 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.975009:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa65a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xea60297 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.975017:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xea60297 (ffff92ae90a6f200) 00010000:00010000:3.0:1788845467.975019:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845467.975022:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa65a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xea60297 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.975038:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b400/0xd8041b54d6dfa65a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xea60297 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845467.975157:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+61:11630:x1875740180177920:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 969us (1188us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845467.975164:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 220 00000100:00100000:2.0:1788845467.979318:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845467.979758:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180178048 00000100:00100000:3.0:1788845467.979771:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180178048 00000100:00100000:3.0:1788845467.979887:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 221 00000100:00100000:3.0:1788845467.979897:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+61:11630:x1875740180178048:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845467.979917:0:8176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845467.979939:0:8176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa661 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752680 expref: -99 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.979974:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.979985:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.979996:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.980102:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748b200/0xd8041b54d6dfa661 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752680 expref: 63 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.980120:0:8176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752680 expref: 62 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.980139:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f300) 00010000:00010000:3.0:1788845467.980142:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788845467.980145:0:8176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748ac00, rc 0) 00000100:00100000:3.0:1788845467.980215:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+62:11630:x1875740180178048:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 320us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845467.980222:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 221 00000100:00100000:1.0:1788845467.983733:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845467.985105:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180178304 00000100:00100000:0.0:1788845467.985121:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180178304 00000100:00100000:0.0:1788845467.985255:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 222 00000100:00100000:0.0:1788845467.985266:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+62:11630:x1875740180178304:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788845467.985395:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa66f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.985411:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa66f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.985422:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa66f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788845467.985788:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788845467.985800:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 277205436745ns, next at 278205434087ns, rc = 0 00000004:00010000:0.0:1788845467.986080:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ce60437 reply state 000000008f547fba transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa66f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845467.986090:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845467.986203:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+64:11630:x1875740180178304:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 938us (2481us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788845467.986210:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 222 00000100:00100000:1.0:1788845467.990951:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845467.991024:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180178432 00000100:00100000:3.0:1788845467.991034:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180178432 00000100:00100000:3.0:1788845467.991104:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 223 00000100:00100000:3.0:1788845467.991114:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+64:11630:x1875740180178432:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845467.991137:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845467.991156:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa676 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752687 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.991229:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752687 expref: 65 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.991245:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752687 expref: 65 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845467.991273:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f300) 00010000:00010000:3.0:1788845467.991276:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845467.991279:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748a800, rc 0) 00000100:00100000:3.0:1788845467.991328:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+65:11630:x1875740180178432:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 217us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845467.991354:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 223 00010000:00010000:0.0:1788845467.992156:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa66f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.992518:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa66f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.992537:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa66f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.992542:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845467.992547:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa66f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.992573:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa66f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.992588:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f300) 00010000:00010000:0.0:1788845467.992590:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788845467.992594:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa66f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845467.992601:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa66f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845467.995411:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845467.995676:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180178560 00000100:00100000:1.0:1788845467.995685:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180178560 00000100:00100000:1.0:1788845467.995743:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:1.0:1788845467.995752:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+9:2373:x1875740180178560:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788845467.996089:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+10:2373:x1875740180178560:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 337us (735us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788845467.996097:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:1.0:1788845468.001544:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845468.001607:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180178816 00000100:00100000:2.0:1788845468.001617:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180178816 00000100:00080000:0.0:1788845468.001737:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845468.001832:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:2.0:1788845468.001844:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+64:11630:x1875740180178816:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788845468.002184:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+65:11630:x1875740180178816:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 339us (655us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788845468.002193:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:3.0:1788845468.004883:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845468.009180:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180179072 00000100:00100000:2.0:1788845468.009199:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180179072 00000100:00100000:2.0:1788845468.009320:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 224 00000100:00100000:2.0:1788845468.009330:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+65:11630:x1875740180179072:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788845468.009799:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+65:11630:x1875740180179072:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 468us (4926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845468.009808:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 224 00000100:00100000:3.0:1788845468.015669:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845468.015890:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180179200 00000100:00100000:0.0:1788845468.015900:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180179200 00000100:00100000:0.0:1788845468.015961:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 225 00000100:00100000:0.0:1788845468.015972:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+65:11630:x1875740180179200:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845468.015992:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845468.016013:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa67d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775268e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.016086:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.016100:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.016111:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845468.016149:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845468.016198:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.016234:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfa67d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775268e expref: 67 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.016255:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775268e expref: 66 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.016264:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f300) 00010000:00010000:0.0:1788845468.016267:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788845468.016271:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845468.016336:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+66:11630:x1875740180179200:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 366us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845468.016343:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 225 00000100:00100000:3.0:1788845468.023725:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845468.023832:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180179328 00000100:00100000:0.0:1788845468.023843:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180179328 00000100:00100000:0.0:1788845468.023916:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:0.0:1788845468.023929:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+10:2372:x1875740180179328:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845468.023947:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845468.023969:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000c6c22d/0xd8041b54d6dfa68b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752695 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788845468.024000:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9d9b, blocks: 0x1 00010000:00010000:0.0:1788845468.024021:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=277s v=(0 0) 00010000:00010000:0.0:1788845468.024025:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845468.024034:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000c6c22d/0xd8041b54d6dfa68b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752695 expref: 11 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.024075:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000c6c22d/0xd8041b54d6dfa68b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752695 expref: 11 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.024089:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030200, rc 0) 00000100:00100000:0.0:1788845468.024483:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+11:2372:x1875740180179328:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 555us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845468.024490:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00080000:2.0:1788845468.024620:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845468.030041:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845468.030123:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180179584 00000100:00100000:0.0:1788845468.030134:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180179584 00000100:00100000:0.0:1788845468.030204:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 226 00000100:00100000:0.0:1788845468.030215:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+66:11630:x1875740180179584:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788845468.030610:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+66:11630:x1875740180179584:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 396us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845468.030618:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 226 00000100:00100000:1.0:1788845468.040778:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845468.044722:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180179712 00000100:00100000:2.0:1788845468.044739:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180179712 00000100:00100000:0.0:1788845468.045016:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:0.0:1788845468.045030:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+11:11630:x1875740180179712:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845468.045047:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845468.045067:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775269c expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.045097:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000c6c22d/0xd8041b54d6dfa68b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752695 expref: 12 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.045128:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845468.045132:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845468.045138:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 12 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.045174:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000c6c22d/0xd8041b54d6dfa68b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752695 expref: 12 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.045200:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000c6c22d/0xd8041b54d6dfa68b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752695 expref: 12 pid: 6659 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845468.045215:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1875740189594624:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845468.045324:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98f17840 going to sleep for 11 seconds 00000100:00100000:3.0:1788845468.052256:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845468.052413:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180179840 00000100:00100000:1.0:1788845468.052423:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180179840 00010000:00010000:1.0:1788845468.052477:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000c6c22d/0xd8041b54d6dfa68b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752695 expref: 13 pid: 6659 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845468.052522:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:1.0:1788845468.052531:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+13:2372:x1875740180179840:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845468.052552:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845468.052577:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000c6c22d/0xd8041b54d6dfa68b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752695 expref: 13 pid: 6659 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.052592:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000c6c22d/0xd8041b54d6dfa68b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752695 expref: 13 pid: 6659 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.052637:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845468.052642:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845468.052650:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 13 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.052661:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 13 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.052682:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000c6c22d/0xd8041b54d6dfa68b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752695 expref: 13 pid: 6659 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.052697:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 12 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845468.052706:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1875740189594624:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845468.052714:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5804:1875740189594752:192.168.206.35@tcp:105: 00010000:00010000:0.0:1788845468.052739:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 12 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.052752:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1ee00, rc 0) 00000100:00100000:0.0:1788845468.052785:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+12:11630:x1875740180179712:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 7760us (12021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845468.052804:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:1.0:1788845468.053094:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845468.059357:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5804:1875740189594752:192.168.206.35@tcp:105: 00010000:00010000:1.0:1788845468.059806:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845468.059879:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+11:2372:x1875740180179840:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 7347us (7633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845468.059891:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:3.0:1788845468.065332:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845468.065579:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180179968 00000100:00100000:1.0:1788845468.065590:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180179968 00002000:00100000:1.0:1788845468.065637:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff92aeae042680 x1875740180179968/t0(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:574/0 lens 504/0 e 0 to 0 dl 1788845479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845468.065650:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeae042680 with x1875740180179968 ext(0->12) 00002000:00010000:1.0:1788845468.065655:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeae042680 00000100:00100000:1.0:1788845468.065706:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:1.0:1788845468.065716:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:704fd1fa-8fb6-403c-867f-b875231088ec+11:2372:x1875740180179968:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788845468.066880:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:704fd1fa-8fb6-403c-867f-b875231088ec+13:2372:x1875740180179968:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 Request processed in 1157us (1552us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788845468.066894:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00002000:00100000:1.0:1788845468.066904:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff92aeae042680 x1875740180179968/t4294967320(0) o4->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:574/0 lens 504/448 e 0 to 0 dl 1788845479 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845468.066914:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeae042680 with x1875740180179968 ext(0->12) 00002000:00010000:1.0:1788845468.066919:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeae042680 00000100:00100000:3.0:1788845468.075720:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845468.075813:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180180096 00000100:00100000:2.0:1788845468.075823:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180180096 00000100:00100000:2.0:1788845468.075952:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 227 00000100:00100000:2.0:1788845468.075963:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+66:11630:x1875740180180096:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788845468.133980:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1788845468.133994:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788845468.134016:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788845468.134031:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92aebc93e180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788845468.134036:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92aeb79d0b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92aebc93e480 00000020:00080000:0.0:1788845468.134039:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92aeb79d0c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92ae9e8ccc00 00000020:00080000:0.0:1788845468.134079:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92aeae210d80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788845468.134082:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92aebc862f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92aeae210300 00000020:00080000:0.0:1788845468.134085:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92aebc862000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92aeb7e20c00 00000001:00080000:0.0:1788845468.134092:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788845468.134132:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788845468.134141:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1788845468.134453:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+20:11630:x1875740180180096:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 Request processed in 58485us (58739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845468.134462:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 227 00000020:00080000:0.0:1788845468.136982:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788845468.137189:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788845468.137201:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845468.137221:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189594880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788845468.137851:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845468.137916:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189595136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788845468.137943:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845468.137968:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845468.137973:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb7b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189595008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788845468.137994:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845468.138022:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189594880 00000100:00100000:0.0:1788845468.138030:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189594880 00000100:00100000:0.0:1788845468.138092:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189595136 00000100:00100000:0.0:1788845468.138095:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189595136 00000100:00100000:0.0:1788845468.138106:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189595008 00000100:00100000:0.0:1788845468.138109:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189595008 00000100:00100000:0.0:1788845468.138122:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788845468.138129:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3283:x1875740189594880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788845468.138154:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788845468.138178:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.138200:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a669997d/0xd8041b54d6dfa45b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525fb expref: 12 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.138208:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788845468.138212:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845468.138217:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788845468.138576:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845468.138580:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845468.138593:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788845468.138603:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875740189595136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788845468.138619:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1788845468.138761:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9d9a, atime: 0x0, ctime: 0x6a9f9d9a, blocks: 0x1 00010000:00010000:1.0:1788845468.138768:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186d8eeb/0xd8041b54d6dfa6a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.138778:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=277s v=(0 0) 00010000:00010000:1.0:1788845468.138782:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845468.138787:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186d8eeb/0xd8041b54d6dfa6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.138802:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186d8eeb/0xd8041b54d6dfa6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.138824:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186d8eeb/0xd8041b54d6dfa6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.138831:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000186d8eeb/0xd8041b54d6dfa6a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.138849:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788845468.139333:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a669997d/0xd8041b54d6dfa45b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.35@tcp remote: 0x461ce120077525fb expref: 12 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.139352:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a669997d/0xd8041b54d6dfa45b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.35@tcp remote: 0x461ce120077525fb expref: 12 pid: 6656 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.139658:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845468.139929:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1875740189595264:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845468.140002:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f71900 going to sleep for 11 seconds 00000100:00100000:0.0:1788845468.140021:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788845468.140035:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:0.0:1788845468.140052:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845468.140059:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000186d8eeb/0xd8041b54d6dfa6a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.140068:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845468.140072:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000186d8eeb/0xd8041b54d6dfa6a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.140082:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000186d8eeb/0xd8041b54d6dfa6a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.140100:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000186d8eeb/0xd8041b54d6dfa6a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.140108:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186d8eeb/0xd8041b54d6dfa6a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.140129:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845468.140131:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845468.140133:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845468.140741:0:12028:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788845468.140753:0:12028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180180224 00000100:00100000:3.0:1788845468.140760:0:12028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180180224 00000100:00100000:1.0:1788845468.140992:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1875740189595136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2389us (3045us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788845468.141000:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788845468.141021:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788845468.141029:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1875740189595008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788845468.141155:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788845468.141159:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788845467 00002000:00010000:1.0:1788845468.141161:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788845468.141163:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788845467 -> 1788845467 00002000:00010000:1.0:1788845468.141165:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788845468.141192:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3286:x1875740189595008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (3197us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788845468.141198:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788845468.141213:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:1.0:1788845468.141219:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+13:2372:x1875740180180224:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788845468.149437:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92aeb7b78000/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788845468.149455:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189595136:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788845468.149623:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92aeb7b7b480/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788845468.149629:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189595008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788845468.149982:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845468.150014:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180180352 00000100:00100000:1.0:1788845468.150031:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180180352 00010000:00010000:1.0:1788845468.150065:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a669997d/0xd8041b54d6dfa45b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.35@tcp remote: 0x461ce120077525fb expref: 14 pid: 6656 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845468.150100:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:1.0:1788845468.150109:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+14:2372:x1875740180180352:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845468.150122:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845468.150127:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a669997d/0xd8041b54d6dfa45b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.35@tcp remote: 0x461ce120077525fb expref: 14 pid: 6656 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.150139:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a669997d/0xd8041b54d6dfa45b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.35@tcp remote: 0x461ce120077525fb expref: 14 pid: 6656 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.150163:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845468.150168:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845468.150185:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.150196:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.150215:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845468.150824:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:704fd1fa-8fb6-403c-867f-b875231088ec+14:2372:x1875740180180352:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 710us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845468.150834:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 84 00010000:00010000:1.0:1788845468.152483:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a669997d/0xd8041b54d6dfa45b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.35@tcp remote: 0x461ce120077525fb expref: 13 pid: 6656 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845468.152599:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1875740189595264:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845468.152626:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.152702:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.152711:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.152721:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.152730:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.152758:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788845468.154338:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845468.154349:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845468.154491:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1f400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845468.154496:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845468.154522:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845468.154549:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845468.154558:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948a111f/0xd8041b54d6dfa699 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845468.154579:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845468.154582:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845468.154584:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845468.155520:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3283:x1875740189594880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17385us (17663us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788845468.155543:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1788845468.155605:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92aeb7b7bb80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788845468.155613:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb7b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189594880:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788845468.185184:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1788845468.185200:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1788845468.185920:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180180224:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 Request processed in 44693us (46256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845468.185933:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:1.0:1788845468.189055:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845468.189154:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180180608 00000100:00100000:3.0:1788845468.189164:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180180608 00000100:00100000:2.0:1788845468.189831:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 228 00000100:00100000:2.0:1788845468.189846:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+20:11630:x1875740180180608:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788845468.189910:0:7234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845468.189936:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfa684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775268e expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.189959:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f300) 00010000:00010000:2.0:1788845468.189964:0:7234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845468.189992:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa6a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.190005:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.190015:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845468.190718:0:7234:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000784a981f reply state 00000000a8e8a16c transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.190731:0:7234:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845468.190843:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+21:11630:x1875740180180608:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 1001us (1798us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788845468.190852:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 228 00010000:00010000:0.0:1788845468.194688:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.194712:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa6a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.194719:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa6a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.194749:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845468.194756:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa6a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.194765:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa6a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.194783:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f300) 00010000:00010000:0.0:1788845468.194786:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845468.194790:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa6a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.194797:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0000/0xd8041b54d6dfa6a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845468.195849:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845468.196131:0:12028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180180736 00000100:00100000:3.0:1788845468.196142:0:12028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180180736 00000100:00100000:3.0:1788845468.196209:0:12028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:3.0:1788845468.196220:0:12028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+7:2373:x1875740180180736:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788845468.196937:0:12028:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788845468.196943:0:12028:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788845467 -> 1788845466 00002000:00010000:3.0:1788845468.196946:0:12028:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788845466 00002000:00010000:3.0:1788845468.196948:0:12028:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788845467 -> 1788845466 00002000:00010000:3.0:1788845468.196961:0:12028:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788845468.197033:0:12028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:704fd1fa-8fb6-403c-867f-b875231088ec+8:2373:x1875740180180736:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 813us (1190us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788845468.197042:0:12028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:2.0:1788845468.199722:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845468.199872:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180180992 00000100:00100000:1.0:1788845468.199883:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180180992 00000100:00100000:1.0:1788845468.199955:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 229 00000100:00100000:1.0:1788845468.199966:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+20:11630:x1875740180180992:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788845468.200032:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.200049:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa668 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752680 expref: 20 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.200058:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.200094:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752680 expref: 20 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.200107:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752680 expref: 20 pid: 8176 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845468.200121:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189595392:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845468.200209:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788845468.202836:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845468.203042:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5817:1875740189595392:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845468.203070:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.203328:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180181120 00000100:00100000:2.0:1788845468.203335:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180181120 00010000:00010000:2.0:1788845468.203589:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752680 expref: 21 pid: 8176 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.203727:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 85 00000100:00100000:2.0:1788845468.203739:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+21:2373:x1875740180181120:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845468.203753:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845468.203760:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752680 expref: 21 pid: 8176 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.203772:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752680 expref: 21 pid: 8176 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.203792:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748ac00/0xd8041b54d6dfa668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752680 expref: 21 pid: 8176 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.203809:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f300) 00010000:00010000:2.0:1788845468.203833:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.203843:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.203849:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.203888:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845468.203948:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+20:2373:x1875740180181120:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 210us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845468.203956:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 85 00010000:00010000:0.0:1788845468.204006:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.204015:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.204046:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.204054:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.204071:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.204077:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845468.204081:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.204089:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.204099:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f300) 00010000:00010000:0.0:1788845468.204102:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788845468.204106:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.204112:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa6ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845468.204154:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+19:11630:x1875740180180992:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 Request processed in 4190us (4444us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788845468.204163:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 229 00000100:00100000:1.0:1788845468.208836:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845468.209096:0:12534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180181248 00000100:00100000:0.0:1788845468.209106:0:12534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180181248 00000100:00100000:0.0:1788845468.209166:0:12534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 71 00000100:00100000:0.0:1788845468.209177:0:12534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:704fd1fa-8fb6-403c-867f-b875231088ec+8:2372:x1875740180181248:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788845468.209223:0:12534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.209245:0:12534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.209270:0:12534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845468.209274:0:12534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845468.209279:0:12534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.209318:0:12534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 8 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.209332:0:12534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 8 pid: 6656 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845468.209347:0:12534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebbccfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12534:1875740189595520:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845468.209834:0:12534:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f716c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845468.216161:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845468.216338:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180181376 00000100:00100000:3.0:1788845468.216347:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180181376 00010000:00010000:3.0:1788845468.216423:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 9 pid: 6656 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845468.216464:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 86 00000100:00100000:3.0:1788845468.216474:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+9:2373:x1875740180181376:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845468.216488:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845468.216512:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 9 pid: 6656 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845468.216526:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 9 pid: 6656 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845468.216550:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845468.216555:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845468.216561:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845468.216571:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845468.216591:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845468.216679:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704fd1fa-8fb6-403c-867f-b875231088ec+9:2373:x1875740180181376:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 206us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845468.216687:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 86 00010000:00010000:0.0:1788845468.217664:0:12534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9ebb248/0xd8041b54d6dfa692 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0x461ce1200775269c expref: 8 pid: 6656 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845468.217685:0:12534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebbccfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12534:1875740189595520:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845468.217710:0:12534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.217721:0:12534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.217729:0:12534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.217770:0:12534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.217780:0:12534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.217790:0:12534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.217798:0:12534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1f200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845468.217802:0:12534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.217811:0:12534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.217827:0:12534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845468.217834:0:12534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b79e80fa/0xd8041b54d6dfa6b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845468.217917:0:12534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180181248:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 Request processed in 8741us (9093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845468.217926:0:12534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 71 00000100:00100000:3.0:1788845468.220890:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845468.221076:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180181632 00000100:00100000:2.0:1788845468.221086:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180181632 00000100:00100000:2.0:1788845468.221138:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 230 00000100:00100000:2.0:1788845468.221147:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+19:11630:x1875740180181632:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788845468.221350:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa6bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.221399:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa6bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.221412:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa6bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.221675:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.221688:0:8176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa676 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752687 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.221715:0:8176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.221748:0:8176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752687 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.221763:0:8176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa676 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752687 expref: 20 pid: 5818 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.221778:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189595648:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845468.221876:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845468.226831:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845468.226960:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180181760 00000100:00100000:1.0:1788845468.226971:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180181760 00010000:00010000:1.0:1788845468.227017:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa676 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752687 expref: 21 pid: 5818 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845468.227073:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:1.0:1788845468.227082:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e842050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+21:2372:x1875740180181760:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845468.227096:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845468.227103:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa676 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752687 expref: 21 pid: 5818 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.227116:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa676 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752687 expref: 21 pid: 5818 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.227137:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f300) 00010000:00010000:1.0:1788845468.227142:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.227152:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.227160:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.227180:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845468.227605:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748a800/0xd8041b54d6dfa676 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752687 expref: 21 pid: 5818 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.227625:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189595648:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845468.227647:0:8176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.227656:0:8176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.227662:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845468.227874:0:8176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788845468.228021:0:8176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788845468.228067:0:8176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788845468.228171:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8176:1875740189595776:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788845468.228222:0:8176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845468.228499:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e842050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704fd1fa-8fb6-403c-867f-b875231088ec+23:2372:x1875740180181760:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 1415us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845468.228508:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:2.0:1788845468.230066:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845468.230112:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189595776 00000100:00100000:0.0:1788845468.230120:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189595776 00000100:00100000:0.0:1788845468.230626:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788845468.230707:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8176:x1875740189595776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788845468.230852:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8176:x1875740189595776:12345-0@lo:1000:mdt00_004.0 Request processed in 152us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845468.230900:0:8176:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1788845468.230906:0:8176:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1788845468.230926:0:8176:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92aeb7b7b480, transno 4294967321 00000100:00100000:2.0:1788845468.230954:0:8176:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff92aeb7b7bb80 x1875740189594880/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788845484 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845468.230967:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8176:1875740189595776:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788845468.230995:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000001:00080000:2.0:1788845468.232173:0:8176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788845468.232514:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8176:1875740189595904:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788845468.232717:0:8176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845468.232801:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845468.232842:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189595904 00000100:00100000:1.0:1788845468.232850:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189595904 00000100:00100000:1.0:1788845468.232950:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788845468.232960:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8176:x1875740189595904:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788845468.233168:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8176:x1875740189595904:12345-0@lo:1000:mdt00_004.0 Request processed in 209us (450us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788845468.233176:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788845468.233252:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8176:1875740189595904:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788845468.233288:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233298:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233305:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233311:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0a00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845468.233316:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233324:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233347:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae90a6f300) 00010000:00010000:2.0:1788845468.233350:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788845468.233415:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233422:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa6c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233453:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233458:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233464:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233468:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845468.233470:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233475:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233482:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:2.0:1788845468.233484:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788845468.233490:0:8176:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa60d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775266b expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233499:0:8176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa60d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775266b expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233515:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa60d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775266b expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.233556:0:8176:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa60d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775266b expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.233568:0:8176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae227800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189596032:192.168.206.35@tcp:105: 00000100:00100000:2.0:1788845468.233646:0:8176:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845468.240036:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845468.240747:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180181888 00000100:00100000:0.0:1788845468.240757:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180181888 00000100:00100000:0.0:1788845468.240826:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:0.0:1788845468.240837:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+24:11628:x1875740180181888:12345-192.168.206.35@tcp:49:lfs.0 00000100:00100000:0.0:1788845468.240981:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+24:11628:x1875740180181888:12345-192.168.206.35@tcp:49:lfs.0 Request processed in 146us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845468.240989:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:0.0:1788845468.243763:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845468.244049:0:8176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae227800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8176:1875740189596032:192.168.206.35@tcp:105: 00010000:00010000:2.0:1788845468.244080:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244091:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa606 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244129:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244142:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244153:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244164:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244172:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244198:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244203:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845468.244207:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244214:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244226:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:2.0:1788845468.244228:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845468.244243:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ca lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244248:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ca lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244258:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa6bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244263:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa6bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244268:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa6bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244273:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845468.244276:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa6bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244292:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa6bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244301:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:2.0:1788845468.244303:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845468.244306:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa6bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.244312:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa6bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.245000:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+23:11630:x1875740180181632:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 23850us (24115us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788845468.245012:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 230 00000020:00080000:2.0:1788845468.245017:0:8176:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788845468.245042:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180182144 00000100:00100000:2.0:1788845468.245049:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180182144 00000100:00100000:1.0:1788845468.245946:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 231 00000100:00100000:1.0:1788845468.245962:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebbccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+23:11628:x1875740180182144:12345-192.168.206.35@tcp:58:lfs.0 00000040:00080000:1.0:1788845468.246331:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788845468.246872:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebbccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+23:11628:x1875740180182144:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 902us (3108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845468.246881:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 231 00000040:00080000:0.0:1788845468.247482:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845468.247488:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845468.247553:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:0.0:1788845468.247560:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788845468.248510:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeb95bc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189596160:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788845468.249205:0:11641:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f719c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845468.249548:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845468.250190:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180182400 00000100:00100000:0.0:1788845468.250199:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180182400 00000100:00100000:0.0:1788845468.250252:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:0.0:1788845468.250263:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+24:11630:x1875740180182400:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788845468.252556:0:5821:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788845468.255052:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788845468.257849:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:1.0:1788845468.257993:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa6d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.258017:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa6d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.258030:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa6d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.258040:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa6d1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.258047:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa6d1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.258053:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa6d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.258096:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788845468.258316:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+26:11630:x1875740180182400:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 8053us (8773us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788845468.258325:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 62 00000020:00080000:1.0:1788845468.258331:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788845468.258488:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180182528 00010000:00010000:3.0:1788845468.258489:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845468.258496:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa6d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.258497:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180182528 00010000:00010000:3.0:1788845468.258503:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845468.258507:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa6d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.258539:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 232 00000100:00100000:2.0:1788845468.258548:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb74e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+26:11631:x1875740180182528:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00010000:00010000:3.0:1788845468.258570:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa6d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00000080:2.0:1788845468.258575:0:5817:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00010000:00010000:3.0:1788845468.258586:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ae93b8eb00) 00010000:00010000:3.0:1788845468.258589:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788845468.258593:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa6d1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845468.258598:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfa6d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845468.258617:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845468.258619:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845468.258621:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845468.258644:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb74e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+26:11631:x1875740180182528:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 97us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845468.258661:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 232 00000100:00100000:0.0:1788845468.260253:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeb95bc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11641:1875740189596160:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788845468.262402:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845468.262516:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180182784 00000100:00100000:1.0:1788845468.262526:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180182784 00000100:00100000:1.0:1788845468.262584:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 233 00000100:00100000:1.0:1788845468.262778:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+25:11631:x1875740180182784:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845468.262805:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845468.262826:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa6d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077526a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.263006:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa6df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.263020:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa6df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.263031:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa6df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845468.263041:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788845468.263297:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfa6d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526a3 expref: 28 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.263319:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa6df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526a3 expref: 27 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.263347:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:1.0:1788845468.263350:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788845468.263403:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09a00, rc 0) 00000100:00100000:1.0:1788845468.263533:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+27:11631:x1875740180182784:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 939us (1179us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788845468.263541:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 233 00000100:00100000:0.0:1788845468.270041:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845468.270506:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180183040 00000100:00100000:2.0:1788845468.270517:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180183040 00000100:00100000:2.0:1788845468.270582:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 234 00000100:00100000:2.0:1788845468.270610:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+27:11631:x1875740180183040:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788845468.270688:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.270704:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.270716:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.270981:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.270989:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.270996:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.271002:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845468.271006:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.271014:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.271026:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:2.0:1788845468.271029:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845468.271033:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.271039:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.271322:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+28:11631:x1875740180183040:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 713us (1291us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788845468.271330:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 234 00000040:00080000:0.0:1788845468.271680:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845468.271685:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845468.272342:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:0.0:1788845468.272354:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788845468.275813:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845468.275941:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180183296 00000100:00100000:1.0:1788845468.275950:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180183296 00000100:00100000:1.0:1788845468.276007:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:1.0:1788845468.276016:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+28:11631:x1875740180183296:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788845468.276253:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+29:11631:x1875740180183296:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 237us (457us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788845468.276261:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:3.0:1788845468.290683:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845468.290869:0:7234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180183424 00000100:00100000:2.0:1788845468.290881:0:7234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180183424 00000100:00100000:2.0:1788845468.290954:0:7234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 235 00000100:00100000:2.0:1788845468.290966:0:7234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+29:11633:x1875740180183424:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845468.290995:0:7234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845468.291017:0:7234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077526aa expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.291093:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa6fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.291107:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa6fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.291118:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa6fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.291132:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa702 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.291139:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.291145:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.291653:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.291673:0:7234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752664 expref: 30 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.291682:0:7234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.293957:0:7234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752664 expref: 30 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.293986:0:7234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752664 expref: 30 pid: 7234 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845468.294009:0:7234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189596288:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845468.294171:0:7234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8600 going to sleep for 11 seconds 00000100:00100000:3.0:1788845468.297628:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845468.297961:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180183680 00000100:00100000:2.0:1788845468.297971:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180183680 00000100:00100000:2.0:1788845468.298035:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:2.0:1788845468.298046:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+31:5611:x1875740180183680:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788845468.299499:0:7234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7234:1875740189596288:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845468.300346:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+32:5611:x1875740180183680:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 2297us (2727us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788845468.300356:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 64 00010000:00010000:1.0:1788845468.300557:0:7234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845468.306032:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845468.306425:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180183808 00000100:00100000:2.0:1788845468.306437:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180183808 00010000:00010000:2.0:1788845468.306486:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752664 expref: 32 pid: 7234 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845468.306538:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:2.0:1788845468.306548:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+32:2372:x1875740180183808:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845468.306564:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845468.306571:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752664 expref: 32 pid: 7234 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.306610:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752664 expref: 32 pid: 7234 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.306633:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfa5f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752664 expref: 32 pid: 7234 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.306652:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:2.0:1788845468.306658:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.306669:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.306677:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845468.306891:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845468.306956:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704fd1fa-8fb6-403c-867f-b875231088ec+31:2372:x1875740180183808:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 409us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845468.306964:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 88 00010000:00010000:1.0:1788845468.308616:0:7234:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.308688:0:7234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845468.308948:0:7234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788845468.308954:0:7234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845468.308974:0:7234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.308990:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309001:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa6fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309007:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa6fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309013:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa6fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309018:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845468.309022:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa6fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309029:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa6fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309041:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:1.0:1788845468.309189:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845468.309195:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa6fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309201:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1000/0xd8041b54d6dfa6fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309221:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309227:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa702 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309234:0:7234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309239:0:7234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0400 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845468.309242:0:7234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309248:0:7234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa702 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309256:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ae931ba700) 00010000:00010000:1.0:1788845468.309258:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845468.309261:0:7234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa702 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309267:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0400/0xd8041b54d6dfa702 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309309:0:7234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1800/0xd8041b54d6dfa6f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526aa expref: 31 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309336:0:7234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526aa expref: 30 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845468.309344:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:1.0:1788845468.309347:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845468.309349:0:7234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0a00, rc 0) 00000100:00100000:1.0:1788845468.310071:0:7234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb7e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:704fd1fa-8fb6-403c-867f-b875231088ec+30:11633:x1875740180183424:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 19092us (19387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845468.310088:0:7234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 235 00010000:00010000:3.0:1788845468.508553:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788845468.989960:0:12573:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845468.989971:0:12573:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845468.990028:0:12573:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:0.0:1788845468.990035:0:12573:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788845469.140689:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845469.141582:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180184064 00000100:00100000:1.0:1788845469.141595:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180184064 00000100:00100000:1.0:1788845469.141658:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 236 00000100:00100000:1.0:1788845469.141669:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+30:11656:x1875740180184064:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1788845469.141693:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845469.141719:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6dfa710 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077526b1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845469.142175:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa717 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845469.142191:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa717 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845469.142204:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa717 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845469.142215:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788845469.142351:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08400/0xd8041b54d6dfa710 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526b1 expref: 33 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845469.142408:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa717 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526b1 expref: 32 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845469.142417:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:1.0:1788845469.142420:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788845469.142423:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09800, rc 0) 00000100:00100000:1.0:1788845469.142496:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:704fd1fa-8fb6-403c-867f-b875231088ec+32:11656:x1875740180184064:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 829us (1821us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788845469.142503:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 236 00000100:00100000:3.0:1788845469.146334:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845469.146698:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180184192 00000100:00100000:0.0:1788845469.146708:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180184192 00000100:00100000:0.0:1788845469.146766:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 237 00000100:00100000:0.0:1788845469.146777:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+32:11656:x1875740180184192:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:0.0:1788845469.146846:0:8176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa725 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845469.146876:0:8176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845469.146887:0:8176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845469.146916:0:8176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845469.146923:0:8176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa725 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845469.146940:0:8176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa725 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845469.146946:0:8176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1fe00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845469.146951:0:8176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa725 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845469.146958:0:8176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa725 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845469.146970:0:8176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:0.0:1788845469.146974:0:8176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845469.146978:0:8176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa725 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845469.146985:0:8176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fe00/0xd8041b54d6dfa725 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845469.147218:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+32:11656:x1875740180184192:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 442us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845469.147226:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 237 00000100:00100000:0.0:1788845469.260245:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845469.260333:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180184320 00000100:00100000:3.0:1788845469.260344:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180184320 00000100:00100000:3.0:1788845469.260443:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 72 00000100:00100000:3.0:1788845469.260453:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+7:2372:x1875740180184320:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:3.0:1788845469.260471:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845469.260492:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa72c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077526b8 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845469.260522:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f9d9a, atime: 0x6a9f9d9a, ctime: 0x6a9f9d9a, blocks: 0xb 00010000:00010000:3.0:1788845469.260540:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=278s v=(0 0) 00010000:00010000:3.0:1788845469.260545:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845469.260554:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa72c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526b8 expref: 8 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845469.260572:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa72c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526b8 expref: 8 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845469.260584:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b000, rc 0) 00000100:00100000:3.0:1788845469.260649:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+8:2372:x1875740180184320:12345-192.168.206.35@tcp:101:cat.0 Request processed in 198us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845469.260655:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 72 00000100:00100000:3.0:1788845469.266318:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845469.266473:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180184448 00000100:00100000:2.0:1788845469.266483:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180184448 00002000:00100000:2.0:1788845469.266531:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff92aeae30ca80 x1875740180184448/t0(0) o3->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:575/0 lens 488/0 e 0 to 0 dl 1788845480 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788845469.266542:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeae30ca80 with x1875740180184448 ext(0->4095) 00002000:00010000:2.0:1788845469.266549:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeae30ca80 00000100:00100000:2.0:1788845469.266671:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:2.0:1788845469.266696:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:704fd1fa-8fb6-403c-867f-b875231088ec+8:2374:x1875740180184448:12345-192.168.206.35@tcp:3:cat.0 00000100:00100000:2.0:1788845469.266947:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:704fd1fa-8fb6-403c-867f-b875231088ec+8:2374:x1875740180184448:12345-192.168.206.35@tcp:3:cat.0 Request processed in 251us (641us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788845469.266954:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00002000:00100000:2.0:1788845469.266961:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff92aeae30ca80 x1875740180184448/t0(0) o3->704fd1fa-8fb6-403c-867f-b875231088ec@192.168.206.35@tcp:575/0 lens 488/4536 e 0 to 0 dl 1788845480 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788845469.266968:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92aeae30ca80 with x1875740180184448 ext(0->4095) 00002000:00010000:2.0:1788845469.266972:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92aeae30ca80 00010000:00010000:0.0:1788845469.531576:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845470.558634:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788845471.326483:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845471.326494:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788845471.326682:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788845471.326689:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788845471.392868:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788845471.392893:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788845471.459527:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845471.459566:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845471.459602:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845471.459719:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845471.459752:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845471.459797:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180184576 00000100:00100000:2.0:1788845471.459806:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180184576 00000100:00100000:2.0:1788845471.459868:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 283 00000100:00100000:2.0:1788845471.459890:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:2374:x1875740180184576:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845471.459961:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a83c90f8-270b-4823-9416-881b40e3aa44+13:2374:x1875740180184576:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 84us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845471.459969:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 283 00000100:00100000:2.0:1788845471.460008:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180184960 00000100:00100000:2.0:1788845471.460013:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180184960 00000100:00100000:2.0:1788845471.460059:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180184832 00000100:00100000:2.0:1788845471.460063:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180184832 00000100:00100000:2.0:1788845471.460088:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:2.0:1788845471.460096:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+8:2374:x1875740180184960:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845471.460137:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+8:2374:x1875740180184960:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 42us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845471.460144:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:2.0:1788845471.460158:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:2.0:1788845471.460164:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180184832:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845471.460188:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:704fd1fa-8fb6-403c-867f-b875231088ec+5:2374:x1875740180184832:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 24us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845471.460195:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:2.0:1788845471.460214:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180184704 00000100:00100000:2.0:1788845471.460217:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180184704 00000100:00100000:2.0:1788845471.460244:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180185088 00000100:00100000:2.0:1788845471.460247:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180185088 00000100:00100000:2.0:1788845471.460268:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 126 00000100:00100000:2.0:1788845471.460274:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+32:2374:x1875740180184704:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845471.460300:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:704fd1fa-8fb6-403c-867f-b875231088ec+32:2374:x1875740180184704:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 27us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845471.460320:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 126 00000100:00100000:2.0:1788845471.460333:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 127 00000100:00100000:2.0:1788845471.460340:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2374:x1875740180185088:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845471.460395:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c53707e2-5013-40b9-a38c-51554aa096c9+5:2374:x1875740180185088:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 55us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845471.460401:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 127 00000100:00080000:2.0:1788845471.460419:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845471.460423:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788845471.460425:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788845471.579994:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845471.837122:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189596416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845471.837197:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845471.837270:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189596416 00000100:00100000:1.0:1788845471.837277:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189596416 00000100:00100000:3.0:1788845471.837719:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189596544:0@lo:400:kworker.0 00000100:00100000:3.0:1788845471.837783:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845471.837814:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189597056:0@lo:400:kworker.0 00000100:00100000:3.0:1788845471.837851:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845471.837871:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845471.837877:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189596928:0@lo:400:kworker.0 00000100:00100000:3.0:1788845471.837899:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845471.837929:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788845471.837940:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189596416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845471.837975:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845471.838166:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189596416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 227us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845471.838179:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788845471.838246:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae30ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189596672:0@lo:400:kworker.0 00000100:00100000:0.0:1788845471.838276:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189596928 00000100:00100000:3.0:1788845471.838278:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845471.838283:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189596928 00000100:00100000:3.0:1788845471.838306:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845471.838313:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189596800:0@lo:400:kworker.0 00000100:00100000:3.0:1788845471.838336:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845471.838495:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189596544 00000100:00100000:3.0:1788845471.838499:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189596544 00000100:00100000:3.0:1788845471.838642:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788845471.838649:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189596544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845471.838685:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3284:x1875740189596544:12345-0@lo:400:kworker.0 Request processed in 36us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845471.838691:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788845471.838717:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189597056 00000100:00100000:3.0:1788845471.838721:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189597056 00000100:00100000:3.0:1788845471.838744:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788845471.838751:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3284:x1875740189597056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845471.838847:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3284:x1875740189597056:12345-0@lo:400:kworker.0 Request processed in 87us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845471.838854:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788845471.838874:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189596672 00000100:00100000:3.0:1788845471.838884:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189596672 00000100:00100000:0.0:1788845471.839250:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189596800 00000100:00100000:0.0:1788845471.839256:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189596800 00000100:00100000:3.0:1788845471.839261:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788845471.839272:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189596928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845471.839282:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788845471.839290:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189596672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845471.839446:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189596672:12345-0@lo:400:kworker.0 Request processed in 156us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845471.839453:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788845471.839467:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788845471.839475:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189596800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845471.839507:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189596800:12345-0@lo:400:kworker.0 Request processed in 34us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845471.839512:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788845471.839660:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189596928:12345-0@lo:400:kworker.0 Request processed in 390us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845471.839667:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788845471.839718:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189596928:0@lo:400:kworker.0 00000100:00100000:3.0:1788845471.839732:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189596544:0@lo:400:kworker.0 00000100:00100000:3.0:1788845471.839743:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189597056:0@lo:400:kworker.0 00000100:00100000:3.0:1788845471.839856:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189596800:0@lo:400:kworker.0 00000100:00100000:3.0:1788845471.839867:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae30ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189596672:0@lo:400:kworker.0 00000100:00100000:3.0:1788845471.839894:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788845471.839900:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1788845471.839984:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92aeb7b78000, transno 4294967310 00000100:00100000:3.0:1788845471.840071:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189596416:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788845471.840133:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845471.840140:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845471.840142:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845472.347779:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845472.347805:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189597184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845472.347893:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845472.353174:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189597184 00000100:00100000:1.0:1788845472.353191:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189597184 00000100:00100000:1.0:1788845472.353439:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788845472.353452:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875740189597184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845472.353493:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845472.354014:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875740189597184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 563us (6119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845472.354023:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788845472.354119:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189597184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788845472.606875:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845473.139458:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845473.140244:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180185216 00000100:00100000:0.0:1788845473.140256:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180185216 00000100:00100000:0.0:1788845473.140329:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 238 00000100:00100000:0.0:1788845473.140344:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+32:11309:x1875740180185216:12345-192.168.206.35@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788845473.140470:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+32:11309:x1875740180185216:12345-192.168.206.35@tcp:60:lhsmtool_posix.0 Request processed in 132us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845473.140478:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 238 00000100:00080000:2.0:1788845473.140541:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845473.149256:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845473.149591:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180185472 00000100:00100000:1.0:1788845473.149601:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180185472 00000100:00100000:1.0:1788845473.149667:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:1.0:1788845473.149678:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+32:11309:x1875740180185472:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788845473.149947:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+33:11309:x1875740180185472:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 270us (703us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788845473.149956:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:3.0:1788845473.337255:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845473.337482:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180185600 00000100:00100000:2.0:1788845473.337492:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180185600 00000100:00080000:0.0:1788845473.337627:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845473.337721:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 239 00000100:00100000:2.0:1788845473.337733:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c53707e2-5013-40b9-a38c-51554aa096c9+5:12106:x1875740180185600:12345-192.168.206.35@tcp:101:lsof.0 00010000:00010000:2.0:1788845473.337754:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845473.337773:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077526bf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845473.337845:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa73a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845473.337857:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845473.337869:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845473.337906:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788845473.337910:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845473.337931:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845473.337954:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1600/0xd8041b54d6dfa733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526bf expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845473.337983:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa73a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526bf expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845473.338008:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae931ba000) 00010000:00010000:2.0:1788845473.338011:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845473.338014:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1c00, rc 0) 00000100:00100000:2.0:1788845473.338072:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c53707e2-5013-40b9-a38c-51554aa096c9+6:12106:x1875740180185600:12345-192.168.206.35@tcp:101:lsof.0 Request processed in 342us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845473.338079:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 239 00000001:00080000:0.0:1788845473.422818:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1788845473.422850:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1788845473.424584:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967513 is committed 00000020:00080000:1.0:1788845473.424596:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1788845473.424617:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788845473.424645:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ae8fc04cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788845473.424651:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ae916fa400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ae8fc04000 00000020:00080000:1.0:1788845473.424654:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ae916fa500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92aeae104400 00000020:00080000:0.0:1788845473.424711:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788845473.424940:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788845473.627632:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845474.652187:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845475.677583:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845475.892398:0:12774:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:31:14 (1788845474) 00000100:00100000:0.0:1788845476.574599:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845476.574688:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845476.574743:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845476.574766:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845476.574794:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845476.575855:0:12534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180186112 00000100:00100000:3.0:1788845476.575868:0:12534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180186112 00000100:00100000:3.0:1788845476.575932:0:12534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180185984 00000100:00100000:3.0:1788845476.575936:0:12534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180185984 00000100:00100000:3.0:1788845476.575961:0:12534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:3.0:1788845476.575971:0:12534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:704fd1fa-8fb6-403c-867f-b875231088ec+7:2375:x1875740180186112:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845476.576047:0:12534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:704fd1fa-8fb6-403c-867f-b875231088ec+7:2375:x1875740180186112:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 78us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845476.576055:0:12534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:3.0:1788845476.576070:0:12534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:3.0:1788845476.576076:0:12534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:704fd1fa-8fb6-403c-867f-b875231088ec+5:2375:x1875740180185984:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845476.576099:0:12534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:704fd1fa-8fb6-403c-867f-b875231088ec+5:2375:x1875740180185984:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 23us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845476.576104:0:12534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00080000:2.0:1788845476.576284:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788845476.576289:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845476.576896:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180185728 00000100:00100000:0.0:1788845476.576903:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180185728 00000100:00100000:0.0:1788845476.576952:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 285 00000100:00100000:0.0:1788845476.576961:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2375:x1875740180185728:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845476.577004:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a83c90f8-270b-4823-9416-881b40e3aa44+13:2375:x1875740180185728:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 45us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845476.577011:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 285 00000100:00100000:1.0:1788845476.580208:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180185856 00000100:00100000:1.0:1788845476.580225:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180185856 00000100:00100000:1.0:1788845476.580298:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180186240 00000100:00100000:1.0:1788845476.580301:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180186240 00000100:00100000:1.0:1788845476.580333:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 131 00000100:00100000:1.0:1788845476.580343:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+19:2375:x1875740180185856:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845476.580446:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:704fd1fa-8fb6-403c-867f-b875231088ec+19:2375:x1875740180185856:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 104us (5859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845476.580454:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 131 00000100:00100000:1.0:1788845476.580473:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 132 00000100:00100000:1.0:1788845476.580488:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c53707e2-5013-40b9-a38c-51554aa096c9+6:2375:x1875740180186240:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845476.580516:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c53707e2-5013-40b9-a38c-51554aa096c9+6:2375:x1875740180186240:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 29us (5721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845476.580522:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 132 00000100:00080000:2.0:1788845476.580615:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788845476.699630:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845476.955530:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845476.955555:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189597312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845476.955568:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189597440:0@lo:400:kworker.0 00000100:00100000:0.0:1788845476.955902:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189597568:0@lo:400:kworker.0 00000100:00100000:2.0:1788845476.955990:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189597824:0@lo:400:kworker.0 00000100:00100000:3.0:1788845476.956179:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845476.956233:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189597952:0@lo:400:kworker.0 00000100:00100000:3.0:1788845476.956259:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845476.956272:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845476.956282:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845476.956293:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845476.956313:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189597696:0@lo:400:kworker.0 00000100:00100000:1.0:1788845476.956346:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845476.956396:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189597952 00000100:00100000:0.0:1788845476.956403:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189597952 00000100:00100000:0.0:1788845476.956452:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189597568 00000100:00100000:0.0:1788845476.956455:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189597568 00000100:00100000:0.0:1788845476.956472:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189597696 00000100:00100000:0.0:1788845476.956474:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189597696 00000100:00100000:0.0:1788845476.956490:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788845476.956498:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189597952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845476.956675:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189597952:12345-0@lo:400:kworker.0 Request processed in 177us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845476.956683:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788845476.956701:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788845476.956707:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189597568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845476.956742:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189597568:12345-0@lo:400:kworker.0 Request processed in 36us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845476.956769:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788845476.956782:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189597312 00000100:00100000:0.0:1788845476.956787:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788845476.956788:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189597312 00000100:00100000:0.0:1788845476.956798:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189597696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845476.956837:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788845476.956847:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189597312:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845476.956854:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189597696:12345-0@lo:400:kworker.0 Request processed in 56us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845476.956862:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00002000:00000024:1.0:1788845476.956881:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845476.956902:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189597568:0@lo:400:kworker.0 00000100:00100000:1.0:1788845476.956926:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189597312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845476.956939:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788845476.957050:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788845476.957194:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788845476.957199:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845476.957254:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189597824 00000100:00100000:0.0:1788845476.957259:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189597824 00000100:00100000:0.0:1788845476.957661:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788845476.957670:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189597824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845476.957712:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189597824:12345-0@lo:400:kworker.0 Request processed in 44us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845476.957719:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788845476.957777:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189597696:0@lo:400:kworker.0 00000100:00100000:1.0:1788845476.957798:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189597312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845476.957886:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189597440 00000100:00100000:0.0:1788845476.957891:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189597440 00000100:00100000:0.0:1788845476.957925:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788845476.957932:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189597440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845476.957963:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189598080:0@lo:400:kworker.0 00000100:00100000:0.0:1788845476.957970:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3283:x1875740189597440:12345-0@lo:400:kworker.0 Request processed in 37us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845476.957977:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788845476.958009:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845476.958052:0:12534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189598080 00000100:00100000:3.0:1788845476.958059:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189597952:0@lo:400:kworker.0 00000100:00100000:3.0:1788845476.958074:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189597440:0@lo:400:kworker.0 00000100:00100000:3.0:1788845476.958124:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189597824:0@lo:400:kworker.0 00000100:00100000:2.0:1788845476.958126:0:12534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189598080 00000100:00100000:2.0:1788845476.958175:0:12534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788845476.958183:0:12534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189598080:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788845476.958183:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845476.958227:0:12534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189598080:12345-0@lo:400:kworker.0 Request processed in 45us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845476.958234:0:12534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788845476.958265:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788845476.958271:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92aeb7b7bb80, transno 4294967322 00000004:00080000:3.0:1788845476.958287:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788845476.958303:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189598080:0@lo:400:kworker.0 00000100:00100000:3.0:1788845477.467729:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845477.467772:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189598208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845477.467854:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845477.468046:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189598208 00000100:00100000:1.0:1788845477.468055:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189598208 00000100:00100000:1.0:1788845477.468109:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788845477.468119:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189598208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845477.468154:0:6660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845477.468252:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189598208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845477.468260:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788845477.470157:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189598208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788845477.729115:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788845478.536661:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788845478.536686:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788845478.536696:0:5850:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1788845478.546878:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845478.547006:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180186496 00000100:00100000:2.0:1788845478.547016:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180186496 00000100:00100000:2.0:1788845478.547190:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00100000:2.0:1788845478.547202:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+19:12327:x1875740180186496:12345-192.168.206.35@tcp:35:umount.0 00000100:00100000:2.0:1788845478.547627:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+20:12327:x1875740180186496:12345-192.168.206.35@tcp:35:umount.0 Request processed in 427us (895us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788845478.547636:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00080000:1.0:1788845478.547693:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845478.550528:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845478.550908:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180186752 00000100:00100000:1.0:1788845478.550918:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180186752 00000100:00100000:1.0:1788845478.550975:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:1.0:1788845478.550985:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+20:12327:x1875740180186752:12345-192.168.206.35@tcp:35:umount.0 00000100:00100000:1.0:1788845478.551747:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+21:12327:x1875740180186752:12345-192.168.206.35@tcp:35:umount.0 Request processed in 760us (1227us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788845478.551756:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:0.0:1788845478.554493:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845478.554557:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180187008 00000100:00100000:2.0:1788845478.554566:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180187008 00000100:00100000:2.0:1788845478.554633:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:2.0:1788845478.554642:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8f8b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+21:12327:x1875740180187008:12345-192.168.206.35@tcp:35:umount.0 00000100:00100000:2.0:1788845478.554985:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8f8b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:704fd1fa-8fb6-403c-867f-b875231088ec+22:12327:x1875740180187008:12345-192.168.206.35@tcp:35:umount.0 Request processed in 343us (504us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788845478.554991:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:0.0:1788845478.557278:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845478.557540:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180187264 00000100:00100000:1.0:1788845478.557549:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180187264 00000100:00100000:1.0:1788845478.557702:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:1.0:1788845478.557717:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+22:12327:x1875740180187264:12345-192.168.206.35@tcp:35:umount.0 00000100:00100000:1.0:1788845478.558206:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:704fd1fa-8fb6-403c-867f-b875231088ec+23:12327:x1875740180187264:12345-192.168.206.35@tcp:35:umount.0 Request processed in 493us (938us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788845478.558224:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:3.0:1788845478.563020:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845478.563071:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845478.563100:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845478.564006:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845478.564745:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180187392 00000100:00100000:2.0:1788845478.564757:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180187392 00000100:00100000:2.0:1788845478.564823:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180187520 00000100:00100000:2.0:1788845478.564827:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180187520 00000100:00100000:2.0:1788845478.564851:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180187648 00000100:00100000:2.0:1788845478.564854:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180187648 00000100:00100000:0.0:1788845478.564872:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:0.0:1788845478.564891:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a83c90f8-270b-4823-9416-881b40e3aa44+15:2375:x1875740180187392:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845478.564907:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845478.564925:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1e800/0xd8041b54d6df9750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775224a expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845478.564945:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845478.564985:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:2.0:1788845478.564994:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a83c90f8-270b-4823-9416-881b40e3aa44+14:2375:x1875740180187520:12345-192.168.206.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788845478.564995:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a83c90f8-270b-4823-9416-881b40e3aa44+14:2375:x1875740180187392:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 115us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845478.565002:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 17 00010000:00010000:2.0:1788845478.565003:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845478.565012:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1e200/0xd8041b54d6df9718 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752212 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845478.565022:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845478.565023:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:0.0:1788845478.565029:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a83c90f8-270b-4823-9416-881b40e3aa44+12:2375:x1875740180187648:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845478.565037:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788845478.565040:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a83c90f8-270b-4823-9416-881b40e3aa44+12:2375:x1875740180187520:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 48us (1969us total) trans 0 rc 0/0 00010000:00010000:0.0:1788845478.565045:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb7fd0600/0xd8041b54d6df99bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752315 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845478.565053:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845478.565066:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a83c90f8-270b-4823-9416-881b40e3aa44+11:2375:x1875740180187648:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 38us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845478.565068:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:0.0:1788845478.565072:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:0.0:1788845478.565089:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180188032 00000100:00100000:0.0:1788845478.565092:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180188032 00000100:00100000:0.0:1788845478.565126:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:0.0:1788845478.565133:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+7:2371:x1875740180188032:12345-192.168.206.35@tcp:9:umount.0 00000020:00000080:0.0:1788845478.565159:0:6656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9cf2 00000020:00010000:0.0:1788845478.565166:0:6656:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92aeb4235000: total 0 00000100:00080000:0.0:1788845478.565262:0:6656:0:(import.c:65:import_set_state_nolock()) ffff92aeb4234800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788845478.565300:0:5805:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92aeb4235000: total 0 00000001:00000004:0.0:1788845478.565306:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:2.0:1788845478.565345:0:5805:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92aeb4235000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788845478.565420:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e34faa35/0xd8041b54d6dfa08e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524ea expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845478.565447:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe0d1b0b/0xd8041b54d6dfa72c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526b8 expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845478.565462:0:5805:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92aeb4235000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788845478.565473:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845478.565475:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845478.565477:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788845478.565584:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845478.565930:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:704fd1fa-8fb6-403c-867f-b875231088ec+2:2371:x1875740180188032:12345-192.168.206.35@tcp:9:umount.0 Request processed in 795us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845478.565937:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:3.0:1788845478.570316:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845478.570461:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180188160 00000100:00100000:0.0:1788845478.570529:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180188160 00000100:00100000:0.0:1788845478.570753:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:0.0:1788845478.570767:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+5:2371:x1875740180188160:12345-192.168.206.35@tcp:9:umount.0 00000020:00000080:0.0:1788845478.570809:0:6658:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9a8a 00000100:00080000:0.0:1788845478.570822:0:6658:0:(import.c:65:import_set_state_nolock()) ffff92aebca03800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788845478.570870:0:6658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788845478.571188:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:704fd1fa-8fb6-403c-867f-b875231088ec+2:2371:x1875740180188160:12345-192.168.206.35@tcp:9:umount.0 Request processed in 410us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845478.571197:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 74 00010000:00010000:3.0:1788845478.571252:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788845478.571396:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845478.578772:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845478.578871:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180189184 00000100:00100000:1.0:1788845478.578880:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180189184 00000100:00100000:1.0:1788845478.578942:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 240 00000100:00100000:1.0:1788845478.578952:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+23:2371:x1875740180189184:12345-192.168.206.35@tcp:39:umount.0 00000020:00000080:1.0:1788845478.578988:0:8176:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9726 00000020:00010000:1.0:1788845478.579006:0:8176:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92aeb95b7800: total 0 00000100:00080000:1.0:1788845478.579011:0:8176:0:(import.c:65:import_set_state_nolock()) ffff92aeb95b4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788845478.579039:0:8176:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1788845478.579483:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:704fd1fa-8fb6-403c-867f-b875231088ec+22:2371:x1875740180189184:12345-192.168.206.35@tcp:39:umount.0 Request processed in 530us (723us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788845478.579491:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 240 00000020:00010000:3.0:1788845478.581568:0:8417:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92aeb95b7800: total 0 00010000:00010000:3.0:1788845478.581633:0:8417:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92aeb95b7800, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1788845478.581668:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae93b8e000) 00010000:00010000:3.0:1788845478.581673:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845478.581683:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08800/0xd8041b54d6df9a0c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775232a expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.581711:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:3.0:1788845478.581714:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845478.581718:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1200/0xd8041b54d6dfa04f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524d5 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.581733:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:3.0:1788845478.581736:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788845478.581740:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09a00/0xd8041b54d6dfa6df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526a3 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.583899:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae931ba000) 00010000:00010000:3.0:1788845478.583923:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788845478.583934:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1e00/0xd8041b54d6dfa0f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752506 expref: 18 pid: 8176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.583951:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ae83de9b00) 00010000:00010000:3.0:1788845478.583954:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788845478.583958:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6df99f0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752323 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.584658:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:3.0:1788845478.584664:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788845478.584671:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0c00/0xd8041b54d6dfa079 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077524e3 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.584687:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:3.0:1788845478.584690:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788845478.584693:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09800/0xd8041b54d6dfa717 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526b1 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.584707:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:3.0:1788845478.584709:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788845478.584713:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1a00/0xd8041b54d6df9a60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775233f expref: 14 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.584724:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:3.0:1788845478.584726:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845478.584729:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfa60d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775266b expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.584758:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ae931ba300) 00010000:00010000:3.0:1788845478.584760:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788845478.584764:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0800/0xd8041b54d6df9d4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752411 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.584779:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:3.0:1788845478.584781:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788845478.584785:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfa10c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775250d expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.584796:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ae83de9300) 00010000:00010000:3.0:1788845478.584798:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788845478.584811:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfa3eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077525df expref: 10 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.584827:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ae93b8e600) 00010000:00010000:3.0:1788845478.584830:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845478.584833:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb748aa00/0xd8041b54d6df9f6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775249d expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.584848:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ae931bad00) 00010000:00010000:3.0:1788845478.584851:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845478.584854:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd0a00/0xd8041b54d6dfa709 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526aa expref: 8 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845478.584868:0:8417:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92aeb95b7800, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1788845478.584903:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845478.584911:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845478.584914:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845478.747516:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845479.771624:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845480.112989:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845480.113087:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180189440 00000100:00100000:2.0:1788845480.113097:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180189440 00000100:00100000:2.0:1788845480.113161:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:2.0:1788845480.113172:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a83c90f8-270b-4823-9416-881b40e3aa44+10:2375:x1875740180189440:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845480.113189:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845480.113208:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1f800/0xd8041b54d6df97ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752289 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845480.113228:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845480.113332:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a83c90f8-270b-4823-9416-881b40e3aa44+9:2375:x1875740180189440:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 161us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845480.113340:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:0.0:1788845480.116528:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845480.116642:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845480.117168:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180189312 00000100:00100000:2.0:1788845480.117178:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180189312 00000100:00100000:2.0:1788845480.117238:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180189568 00000100:00100000:2.0:1788845480.117241:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180189568 00000100:00100000:3.0:1788845480.117244:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:3.0:1788845480.117254:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a83c90f8-270b-4823-9416-881b40e3aa44+10:2374:x1875740180189312:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845480.117269:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845480.117287:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb748bc00/0xd8041b54d6df97f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775225f expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845480.117308:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:2.0:1788845480.117316:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e842c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a83c90f8-270b-4823-9416-881b40e3aa44+9:2374:x1875740180189568:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845480.117325:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845480.117335:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6df99b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775230e expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845480.117347:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845480.117397:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845480.117423:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e842c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a83c90f8-270b-4823-9416-881b40e3aa44+8:2374:x1875740180189568:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 103us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845480.117431:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:3.0:1788845480.119616:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a83c90f8-270b-4823-9416-881b40e3aa44+7:2374:x1875740180189312:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 2350us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845480.119632:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:1.0:1788845480.119950:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845480.120085:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180189824 00000100:00100000:2.0:1788845480.120093:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180189824 00000100:00100000:2.0:1788845480.120185:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 241 00000100:00100000:2.0:1788845480.120194:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c53707e2-5013-40b9-a38c-51554aa096c9+6:2371:x1875740180189824:12345-192.168.206.35@tcp:39:umount.0 00000020:00000080:2.0:1788845480.120229:0:5818:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df980d 00000020:00010000:2.0:1788845480.120237:0:5818:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92aebca06800: total 0 00000100:00080000:2.0:1788845480.120241:0:5818:0:(import.c:65:import_set_state_nolock()) ffff92aebca02000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788845480.120268:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788845480.120588:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c53707e2-5013-40b9-a38c-51554aa096c9+5:2371:x1875740180189824:12345-192.168.206.35@tcp:39:umount.0 Request processed in 393us (637us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788845480.120607:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 241 00000100:00080000:1.0:1788845480.120975:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788845480.121063:0:5806:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92aebca06800: total 0 00010000:00010000:0.0:1788845480.121107:0:5806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92aebca06800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788845480.121139:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae931ba000) 00010000:00010000:0.0:1788845480.121143:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845480.121151:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb7fd1c00/0xd8041b54d6dfa73a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526bf expref: 4 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845480.121174:0:5806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92aebca06800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788845480.121201:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845480.121203:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845480.121204:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845480.140773:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845480.140886:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180190080 00000100:00100000:2.0:1788845480.140896:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180190080 00000100:00100000:2.0:1788845480.140954:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 287 00000100:00100000:2.0:1788845480.140981:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+7:2371:x1875740180190080:12345-192.168.206.35@tcp:251:umount.0 00000020:00000080:2.0:1788845480.141028:0:5810:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9703 00000020:00010000:2.0:1788845480.141036:0:5810:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92aeb79c8000: total 0 00000100:00080000:2.0:1788845480.141040:0:5810:0:(import.c:65:import_set_state_nolock()) ffff92aeb79cc800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788845480.141117:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a83c90f8-270b-4823-9416-881b40e3aa44+3:2371:x1875740180190080:12345-192.168.206.35@tcp:251:umount.0 Request processed in 137us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845480.141124:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 287 00000020:00010000:3.0:1788845480.141730:0:8417:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92aeb79c8000: total 0 00010000:00010000:3.0:1788845480.141736:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845480.141778:0:8417:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92aeb79c8000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788845480.141818:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1fa00/0xd8041b54d6df9757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752251 expref: 2 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845480.141835:0:8417:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92aeb79c8000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788845480.141845:0:8417:0:(genops.c:885:class_export_put()) final put ffff92aeb79c8000/a83c90f8-270b-4823-9416-881b40e3aa44 00010000:00010000:3.0:1788845480.141868:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845480.141871:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845480.141873:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788845480.141934:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb79c8000/a83c90f8-270b-4823-9416-881b40e3aa44 for MGS 00000020:00000080:0.0:1788845480.141981:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aeb79cc800 for MGS 00010000:00010000:0.0:1788845480.795487:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788845481.557993:0:12972:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000040:00080000:0.0:1788845481.566089:0:11641:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845481.566097:0:11641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845481.569668:0:11641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788845481.569687:0:11641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:3.0:1788845481.577585:0:12972:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788845481.578336:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.578354:0:12972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.580418:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.580426:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.580659:0:12972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788845481.580666:0:12972:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788845481.580700:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788845481.580704:0:12972:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788845481.580897:0:12972:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788845481.581055:0:12972:0:(import.c:65:import_set_state_nolock()) ffff92ae9160b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788845481.581175:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845481.581183:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.581193:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81480600 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:3.0:1788845481.581198:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.581209:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845481.581216:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845481.581221:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788845481.581224:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788845481.581236:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788845481.581260:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.581267:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845481.581286:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.581294:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae81480600/0xd8041b54d6df97b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df97c0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.581308:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845481.581310:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845481.581312:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845481.581329:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189598464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845481.581492:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875740189598336:0@lo:39:umount.0 00000100:00100000:2.0:1788845481.581545:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845481.582176:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845481.582404:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189598336 00000100:00100000:3.0:1788845481.582412:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189598336 00000100:00100000:3.0:1788845481.582473:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788845481.582482:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875740189598336:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788845481.582509:0:5817:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9520 00000100:00080000:3.0:1788845481.582527:0:5817:0:(import.c:65:import_set_state_nolock()) ffff92ae97324000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788845481.582596:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3282:x1875740189598336:12345-0@lo:39:umount.0 Request processed in 115us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845481.582604:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788845481.582613:0:5817:0:(genops.c:885:class_export_put()) final put ffff92ae97325000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1788845481.582637:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189598464 00000100:00100000:3.0:1788845481.582642:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189598464 00000100:00100000:3.0:1788845481.582671:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788845481.582678:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+19:3286:x1875740189598464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845481.582701:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845481.585135:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1e600/0xd8041b54d6df97c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df97b9 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.585164:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845481.585277:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3286:x1875740189598464:12345-0@lo:103:ldlm_bl.0 Request processed in 2598us (3104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845481.585289:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788845481.585344:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788845481.585615:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae97325000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1788845481.585724:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92ae9160b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788845481.585743:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875740189598336:0@lo:39:umount.0 00000100:00080000:1.0:1788845481.586128:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788845481.586133:0:12972:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788845481.586137:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788845481.586156:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ae97324000 for lustre-MDT0000 00000100:00100000:3.0:1788845481.586215:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3286:1875740189598464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788845481.587589:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.587607:0:12972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.587614:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.587640:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.587669:0:12972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788845481.587676:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.587682:0:12972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.587689:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.587695:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.587712:0:12972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788845481.587719:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.587726:0:12972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.587732:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.587738:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845481.587827:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845481.587838:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845481.587838:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.587858:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845481.587858:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481400 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:0.0:1788845481.587866:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.587875:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031400 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:3.0:1788845481.587881:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.587893:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845481.587912:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845481.587920:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845481.587922:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00010000:0.0:1788845481.587938:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845481.587944:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788845481.587947:0:8418:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788845481.587987:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845481.587994:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1788845481.588197:0:8417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788845481.588217:0:8417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788845481.588257:0:8417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.588265:0:8417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845481.588305:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845481.588315:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae81481400/0xd8041b54d6df97c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df97ce expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845481.588331:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845481.588333:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845481.588335:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845481.588354:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189598720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845481.588543:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.588553:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae80031400/0xd8041b54d6df96bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df96c4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.588575:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845481.588577:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845481.588579:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845481.588599:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189598592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845481.588673:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845481.588880:0:12972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788845481.588886:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845481.588892:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174e00/0xd8041b54d6df9471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.588901:0:12972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174e00/0xd8041b54d6df9471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.588909:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aec2174e00/0xd8041b54d6df9471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.588914:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92aec2174e00/0xd8041b54d6df9471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845481.588926:0:12972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788845481.588943:0:12972:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788845481.588948:0:12972:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:0.0:1788845481.588955:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189598592 00000100:00100000:0.0:1788845481.588962:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189598592 00000020:01000004:1.0:1788845481.588977:0:12972:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788845481.588981:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788845481.588986:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788845481.588992:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1788845481.588997:0:12972:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92ad813a4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788845481.589003:0:12972:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92ae90d32800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1788845481.589009:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189598720 00000020:00080000:1.0:1788845481.589011:0:12972:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff92aebca06800 c53707e2-5013-40b9-a38c-51554aa096c9 192.168.206.35@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1788845481.589014:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189598720 00000020:00080000:1.0:1788845481.589020:0:12972:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff92aeb95b7800 704fd1fa-8fb6-403c-867f-b875231088ec 192.168.206.35@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:1.0:1788845481.589024:0:12972:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff92aeae510000) has exports, disconnecting them 00000020:00080000:1.0:1788845481.589029:0:12972:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92ad813a4000), last request at 1788845476 00000020:00000080:1.0:1788845481.589036:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9685 00000100:00080000:1.0:1788845481.589059:0:12972:0:(import.c:65:import_set_state_nolock()) ffff92ad813a3800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788845481.589080:0:12972:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92ad813a4000): rc 0 00000020:00000080:1.0:1788845481.589083:0:12972:0:(genops.c:885:class_export_put()) final put ffff92ad813a4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788845481.589103:0:12972:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92ae90d32800), last request at 1788845476 00000020:00000080:1.0:1788845481.589106:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df95ba 00010000:00010000:3.0:1788845481.589114:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00080000:1.0:1788845481.589116:0:12972:0:(import.c:65:import_set_state_nolock()) ffff92ae90d34800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788845481.589125:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788845481.589133:0:12972:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92ae90d32800): rc 0 00000020:00000080:1.0:1788845481.589138:0:12972:0:(genops.c:885:class_export_put()) final put ffff92ae90d32800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1788845481.589143:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1f600 already unused, calling callback (ffffffffc1bfac20) 00000004:00000080:1.0:1788845481.589149:0:12972:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaf3e02e87ae0 10000000:00010000:3.0:1788845481.589150:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.589168:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788845481.589173:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 10000000:00010000:3.0:1788845481.589177:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845481.589178:0:12972:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 10000000:01000000:3.0:1788845481.589190:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000004:00080000:1.0:1788845481.589196:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 10000000:01000000:3.0:1788845481.589204:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788845481.589207:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788845481.589235:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.589242:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845481.589263:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.589269:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6df99aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df99b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.589281:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845481.589285:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aec2174e00/0xd8041b54d6df9471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.589290:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174e00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:3.0:1788845481.589293:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174e00/0xd8041b54d6df9471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.589300:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aec2174e00/0xd8041b54d6df9471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845481.589307:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aec2174e00/0xd8041b54d6df9471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845481.589313:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788845481.589316:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788845481.589320:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1788845481.589330:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788845481.589335:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aec2174e00/0xd8041b54d6df9471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845481.589345:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae30fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3283:x1875740189598592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788845481.589385:0:6672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845481.589403:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb748ae00/0xd8041b54d6df97ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df97c7 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845481.589418:0:6672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845481.589462:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae30fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:3283:x1875740189598592:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (789us total) trans 0 rc 0/0 00010000:00010000:3.0:1788845481.589468:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788845481.589471:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788845481.589487:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aec2174e00/0xd8041b54d6df9471 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.589496:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aec2174e00/0xd8041b54d6df9471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df9478 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.589514:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845481.589516:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845481.589521:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845481.589535:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788845481.589556:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ad813a4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788845481.589605:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae90d32800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788845481.589633:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ad813a3800 for lustre-MDT0000 00000020:00000080:3.0:1788845481.589646:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ae90d34800 for lustre-MDT0000 00000100:00100000:3.0:1788845481.589666:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189598848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845481.589715:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845481.589748:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845481.589759:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189598976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845481.589822:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845481.589878:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189598848 00000100:00100000:3.0:1788845481.589885:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189598848 00000100:00100000:2.0:1788845481.589914:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189598592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845481.589932:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189598976 00000100:00100000:3.0:1788845481.589938:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189598976 00000100:00100000:3.0:1788845481.589976:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788845481.589985:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+18:3285:x1875740189598848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845481.589998:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845481.590018:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb748be00/0xd8041b54d6df99b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df99aa expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.590031:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845481.590067:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+17:3285:x1875740189598848:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845481.590074:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788845481.590090:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788845481.590096:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+16:3285:x1875740189598976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845481.590104:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845481.590112:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae89a53400/0xd8041b54d6df9478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df9471 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.590122:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845481.590243:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:3285:x1875740189598976:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845481.590249:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788845481.590307:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189598976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845481.590320:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3285:1875740189598848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845481.590339:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788845481.590349:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845481.590354:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+15:3284:x1875740189598720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845481.590398:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845481.590414:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81481800/0xd8041b54d6df96c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df96bd expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845481.590421:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845481.590433:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845481.590488:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:3284:x1875740189598720:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845481.590495:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788845481.590672:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189598720:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788845481.591314:0:12972:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788845481.591340:0:12972:0:(import.c:65:import_set_state_nolock()) ffff92aeb79e5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788845481.591376:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788845481.591502:0:12972:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788845481.591518:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788845481.591575:0:12972:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788845481.591588:0:12972:0:(import.c:65:import_set_state_nolock()) ffff92aeb7591800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788845481.591625:0:12972:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92aeae510000) has no exports 00000100:00100000:1.0:1788845481.592695:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189599104:0@lo:9:umount.0 00000100:00100000:1.0:1788845481.592757:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845481.592800:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189599232:0@lo:9:umount.0 00000100:00100000:1.0:1788845481.592830:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845481.593355:0:12028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189599104 00000100:00100000:3.0:1788845481.593417:0:12028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189599104 00000100:00100000:3.0:1788845481.593463:0:12028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189599232 00000100:00100000:3.0:1788845481.593465:0:12028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189599232 00000100:00100000:3.0:1788845481.593484:0:12028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788845481.593503:0:12028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875740189599104:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788845481.593527:0:12028:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9607 00000100:00080000:1.0:1788845481.593528:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845481.593534:0:5813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845481.595303:0:12028:0:(import.c:65:import_set_state_nolock()) ffff92ae885b7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788845481.595399:0:12028:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1788845481.595440:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845481.595842:0:12028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3282:x1875740189599104:12345-0@lo:9:umount.0 Request processed in 2337us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845481.595854:0:12028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788845481.595884:0:12028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788845481.595895:0:12028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875740189599232:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788845481.595920:0:12028:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df96ee 00000100:00080000:3.0:1788845481.595929:0:12028:0:(import.c:65:import_set_state_nolock()) ffff92aeb7597000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788845481.595951:0:12028:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:1.0:1788845481.596056:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92aeb79e5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788845481.596070:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788845481.596091:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788845481.596096:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189599104:0@lo:9:umount.0 00000100:00100000:3.0:1788845481.596501:0:12028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3282:x1875740189599232:12345-0@lo:9:umount.0 Request processed in 608us (3670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845481.596508:0:12028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1788845481.596526:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788845481.596685:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92aeb7591800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788845481.596704:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788845481.596706:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788845481.596709:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189599232:0@lo:9:umount.0 00000020:00080000:1.0:1788845481.604252:0:12972:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92aeae510000) has no exports 00000001:00100000:3.0:1788845481.619604:0:6682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00000020:00000080:3.0:1788845481.619614:0:6682:0:(genops.c:885:class_export_put()) final put ffff92aebca04800/704fd1fa-8fb6-403c-867f-b875231088ec 00000020:00000080:0.0:1788845481.619680:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92aebca04800/704fd1fa-8fb6-403c-867f-b875231088ec for lustre-OST0000 00000020:00000080:0.0:1788845481.619750:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aebca03800 for lustre-OST0000 00000020:00000080:1.0:1788845481.653083:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df94cc 00000020:00000080:1.0:1788845481.653101:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeae522800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788845481.653204:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788845481.653357:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae522800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788845481.653561:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788845481.653584:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788845481.653589:0:12972:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff92aeb4d4cd28) has no exports 00000020:00000080:2.0:1788845481.654216:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df94c5 00000020:00000080:2.0:1788845481.654224:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeb4d45800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788845481.654290:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb4d45800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788845481.654353:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788845481.654566:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788845481.654585:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeb4d43000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788845481.654588:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb4d43000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788845481.654599:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788845481.819837:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845482.075957:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845482.075981:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189599616:0@lo:400:kworker.0 00000100:00100000:3.0:1788845482.076056:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845482.076148:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189599616 00000100:00100000:0.0:1788845482.076290:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875740189599488:0@lo:400:kworker.0 00000100:00100000:0.0:1788845482.076323:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845482.076352:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845482.076358:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189599360:0@lo:400:kworker.0 00000100:00100000:0.0:1788845482.076429:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845482.076457:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189599488 00000100:00100000:0.0:1788845482.076464:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189599488 00000100:00100000:0.0:1788845482.076505:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788845482.076512:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3284:x1875740189599488:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788845482.076520:0:5818:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788845482.076559:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3284:x1875740189599488:12345-0@lo:400:kworker.0 Request processed in 45us (235us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788845482.076565:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1788845482.076602:0:3284:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788845482.076607:0:3284:0:(import.c:65:import_set_state_nolock()) ffff92aead935800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788845482.076611:0:3284:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788845482.077601:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189599360 00000100:00100000:1.0:1788845482.077612:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189599360 00000100:00100000:1.0:1788845482.077671:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788845482.077681:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae916ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:3284:x1875740189599360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845482.077810:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae916ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6+14:3284:x1875740189599360:12345-0@lo:400:kworker.0 Request processed in 130us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845482.077817:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788845482.077962:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189599616 00000100:00100000:3.0:1788845482.077992:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788845482.078015:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3286:x1875740189599616:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788845482.078022:0:5819:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788845482.078057:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3286:x1875740189599616:12345-0@lo:400:kworker.0 Request processed in 41us (2001us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788845482.078063:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788845482.078117:0:3286:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788845482.078121:0:3286:0:(import.c:65:import_set_state_nolock()) ffff92ad819a0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788845482.078125:0:3286:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788845482.078131:0:3286:0:(import.c:65:import_set_state_nolock()) ffff92ad819a0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788845482.078135:0:3286:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 144 00000100:00080000:3.0:1788845482.078142:0:3286:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92ad819a0800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1788845482.078350:0:3286:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aebc682300 x1875740189599744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788845482.078392:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875740189599616:0@lo:400:kworker.0 00000100:00100000:1.0:1788845482.078566:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875740189599744:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788845482.078606:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845482.078801:0:8176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189599744 00000100:00100000:3.0:1788845482.078806:0:8176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189599744 00000100:00100000:3.0:1788845482.078838:0:8176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788845482.078843:0:8176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3282:x1875740189599744:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788845482.078870:0:8176:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788845482.115084:0:8176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3282:x1875740189599744:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 36227us (36466us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788845482.115101:0:8176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788845482.115163:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92ad819a0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788845482.115170:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788845482.115174:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875740189599744:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788845482.120422:0:3284:0:(import.c:65:import_set_state_nolock()) ffff92aead935800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788845482.120439:0:3284:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 123 00000100:00080000:0.0:1788845482.121353:0:3284:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92aead935800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:0.0:1788845482.121471:0:3284:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aeadc87480 x1875740189599872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788845482.121507:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875740189599488:0@lo:400:kworker.0 00000100:00100000:0.0:1788845482.121558:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3284:1875740189599360:0@lo:400:kworker.0 00000100:00100000:1.0:1788845482.121668:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875740189599872:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788845482.121736:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845482.122050:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189599872 00000100:00100000:2.0:1788845482.122057:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189599872 00000100:00100000:2.0:1788845482.122102:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788845482.122110:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875740189599872:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788845482.122127:0:5819:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788845482.122177:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875740189599872:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 65us (440us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788845482.122184:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1788845482.122340:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92aead935800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788845482.122345:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788845482.122348:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875740189599872:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1788845482.843591:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788845483.655973:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00000001:00080000:1.0:1788845483.655989:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1788845483.656001:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c53707e2-5013-40b9-a38c-51554aa096c9 00000001:00080000:1.0:1788845483.656006:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788845483.656009:0:5839:0:(genops.c:885:class_export_put()) final put ffff92aebca06800/c53707e2-5013-40b9-a38c-51554aa096c9 00000020:00000080:1.0:1788845483.656025:0:5839:0:(genops.c:885:class_export_put()) final put ffff92aeb95b7800/704fd1fa-8fb6-403c-867f-b875231088ec 00000020:00000080:1.0:1788845483.656038:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aebca06800/c53707e2-5013-40b9-a38c-51554aa096c9 for lustre-MDT0000 00000020:00000080:1.0:1788845483.656089:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb95b7800/704fd1fa-8fb6-403c-867f-b875231088ec for lustre-MDT0000 00000020:00000080:1.0:1788845483.656120:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aebca02000 for lustre-MDT0000 00000020:00000080:1.0:1788845483.656124:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aeb95b4000 for lustre-MDT0000 00000020:01000000:1.0:1788845483.679115:0:12972:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ae82a5bc00 - data ffff92ae9ec9faf8/ffff92aebc7bb000 00000020:01000000:1.0:1788845483.679285:0:12972:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ae916a5780 - data ffff92ae9eed1948/ffff92ae973c9400 00000001:00100000:0.0:1788845483.699589:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 704fd1fa-8fb6-403c-867f-b875231088ec 00000020:00000080:0.0:1788845483.699622:0:7612:0:(genops.c:885:class_export_put()) final put ffff92aeb4235000/704fd1fa-8fb6-403c-867f-b875231088ec 00000001:00100000:0.0:1788845483.699652:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788845483.699655:0:7612:0:(genops.c:885:class_export_put()) final put ffff92aeb7595800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788845483.700626:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb4235000/704fd1fa-8fb6-403c-867f-b875231088ec for lustre-OST0001 00000020:00000080:1.0:1788845483.700694:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb7595800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788845483.700722:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aeb4234800 for lustre-OST0001 00000020:00000080:1.0:1788845483.700727:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aeb7597000 for lustre-OST0001 00000001:00000004:1.0:1788845483.706055:0:12972:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1788845483.798011:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788845483.798022:0:12972:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788845483.798037:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788845483.798051:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788845483.798960:0:6808:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788845483.798967:0:6808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788845483.798978:0:6808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788845483.800541:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788845483.800550:0:12972:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788845483.800572:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788845483.800577:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788845483.800883:0:8059:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788845483.800891:0:8059:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788845483.800905:0:8059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00010000:00010000:0.0:1788845483.867795:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788845483.898304:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9494 00000020:00000080:1.0:1788845483.898317:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeae479000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788845483.899748:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df94a9 00000020:00000080:1.0:1788845483.899758:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeae521000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788845483.899765:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788845483.899790:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788845483.899798:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788845483.899804:0:12972:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff92aeae513370) has no exports 00000020:00000080:0.0:1788845483.900178:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae479000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788845483.900192:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae521000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788845483.900274:0:12972:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788845483.900285:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df96e7 00000020:00000080:1.0:1788845483.900290:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeb7590800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788845483.900338:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788845483.900343:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788845483.900352:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788845483.900355:0:12972:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff92ae8ff099b8) has no exports 00000020:00000080:1.0:1788845483.900390:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df96e0 00000020:00000080:1.0:1788845483.900396:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeb7593000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788845483.901152:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb7590800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788845483.901674:0:12972:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788845483.901680:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788845483.901685:0:12972:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788845483.901693:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788845483.901695:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788845483.901737:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788845483.901749:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788845483.901757:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9600 00000020:00000080:1.0:1788845483.901763:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeb79e2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788845483.901767:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788845483.901783:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788845483.901787:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788845483.901791:0:12972:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff92aeb4d48000) has no exports 00000020:00000080:1.0:1788845483.901797:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df95f9 00000020:00000080:1.0:1788845483.901801:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeb79e2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788845483.902167:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb7593000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788845483.902177:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aeb7591800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788845483.902184:0:8:0:(genops.c:885:class_export_put()) final put ffff92ad813a5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788845483.902186:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ad813a5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788845483.902191:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788845483.902276:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb79e2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788845483.902282:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb79e2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788845483.902696:0:12972:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788845483.902700:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788845483.902704:0:12972:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788845483.902709:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788845483.902711:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788845483.902812:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788845483.902820:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788845483.902852:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788845483.902856:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788845483.902860:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeae47e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788845483.902862:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae47e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788845483.902867:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788845483.903034:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df94b0 00000020:00000080:1.0:1788845483.903040:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeae526000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788845483.903221:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aeb79e5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788845483.903229:0:8:0:(genops.c:885:class_export_put()) final put ffff92aeb79e7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788845483.903232:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb79e7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788845483.903236:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788845483.903469:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788845483.903475:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788845483.903480:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788845483.903484:0:12972:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff92aeae514d28) has no exports 00000020:00000080:1.0:1788845483.903510:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788845483.903514:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788845483.903519:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df94b7 00000020:00000080:1.0:1788845483.903524:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeae527800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788845483.903533:0:12972:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92ae90de3800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788845483.903537:0:12972:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ae90de3800 3 00000020:01000004:1.0:1788845483.903540:0:12972:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92ae90de3800 from lustre-MDT0000 00000020:00000080:1.0:1788845483.903558:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788845483.903562:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788845483.903565:0:12972:0:(genops.c:885:class_export_put()) final put ffff92aeae47e000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788845483.903567:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae47e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788845483.903575:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788845483.903607:0:12972:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788845483.903611:0:12972:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788845483.903614:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788845483.903616:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788845483.903619:0:12972:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788845483.903626:0:12972:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff92ae8fcad800 e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788845483.903632:0:12972:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff92ae8ff08000) has exports, disconnecting them 00000020:00080000:1.0:1788845483.903646:0:12972:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff92ae8fcad800), last request at 1788845299 00000020:00000080:1.0:1788845483.903662:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9455 00000020:00010000:1.0:1788845483.903666:0:12972:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92ae8fcad800: total 2 00000100:00080000:1.0:1788845483.903670:0:12972:0:(import.c:65:import_set_state_nolock()) ffff92ae8fcab000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788845483.903729:0:12972:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92ae8fcad800): rc 0 00000020:00080000:1.0:1788845483.903734:0:12972:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff92ae8ff08000) has no exports 00000100:00100000:1.0:1788845483.903802:0:5811:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff92ae91648600:5811] 1 exiting: rc = 0 00000100:00100000:1.0:1788845483.903889:0:5810:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff92ae91648000:5810] 0 exiting: rc = 1 00000100:00100000:0.0:1788845483.904051:0:5812:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff92ae8644f000:5812] 2 exiting: rc = 0 00000020:00000080:0.0:1788845483.904091:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae526000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788845483.904095:0:8:0:(genops.c:885:class_export_put()) final put ffff92aeae47f000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788845483.904098:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae47f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788845483.904101:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788845483.904276:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae527800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788845483.904481:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904492:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904499:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904505:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904511:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904517:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904524:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904531:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904537:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904544:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904550:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904557:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904563:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904569:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904576:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904583:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904590:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904596:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904603:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904609:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904615:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904621:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904628:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904634:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904640:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904655:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904661:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904667:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904673:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904678:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904684:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904689:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904696:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904701:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904708:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904714:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904721:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904726:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904732:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904737:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904743:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904748:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904753:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904759:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904764:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904769:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904784:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904790:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904795:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904801:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904806:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904812:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904818:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904825:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904830:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904835:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904840:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904845:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904850:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904855:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904867:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904872:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904878:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845483.904883:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788845483.905532:0:12972:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788845483.905536:0:12972:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:3.0:1788845483.905909:0:5806:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92ae8fcad800: total 0 00010000:00010000:3.0:1788845483.905954:0:5806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92ae8fcad800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788845483.905991:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aec2175000/0xd8041b54d6df956d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df9566 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845483.906015:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1ea00/0xd8041b54d6df976c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df9765 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845483.906026:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1e400/0xd8041b54d6df97ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df97e3 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845483.906037:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1ec00/0xd8041b54d6df977a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df9773 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845483.906050:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fc08600/0xd8041b54d6df99a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df999c expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845483.906061:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81481a00/0xd8041b54d6df9796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df978f expref: 4 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845483.906073:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb7fd0200/0xd8041b54d6df9995 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df998e expref: 3 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845483.906087:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae81481600/0xd8041b54d6df97a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd8041b54d6df979d expref: 2 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845483.906099:0:5806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92ae8fcad800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788845483.906121:0:5806:0:(genops.c:885:class_export_put()) final put ffff92ae8fcad800/e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6 00010000:00010000:3.0:1788845483.906145:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845483.906148:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845483.906150:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788845483.906191:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae8fcad800/e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6 for MGS 00000020:00000080:1.0:1788845483.906234:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ae8fcab000 for MGS 00000020:01000000:1.0:1788845483.907025:0:12972:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ae8fd5b420 - data ffff92ae9ee72438/ffff92ad8298cc00 00000020:01000000:1.0:1788845483.907157:0:12972:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ae850fd240 - data ffff92ae9ec4fe58/ffff92aea67c7c00 00000020:00000080:1.0:1788845483.908060:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9439 00000020:00000080:1.0:1788845483.908068:0:12972:0:(genops.c:885:class_export_put()) final put ffff92ae90d91000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788845483.908123:0:12972:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92ae90de3800 from MGS, refs=2 00000020:01000004:1.0:1788845483.908128:0:12972:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ae90de3800 2 00000020:01000004:1.0:1788845483.908131:0:12972:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92ae90de3800 from MGS 00000020:00000080:1.0:1788845483.908155:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788845483.908162:0:12972:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788845483.908165:0:12972:0:(genops.c:885:class_export_put()) final put ffff92ae90d91800/MGS 00000020:00000080:1.0:1788845483.908168:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae90d91800/MGS for MGS 00000020:01000000:1.0:1788845483.908174:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788845483.908238:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788845483.908242:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788845483.908248:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788845483.908255:0:12972:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff92ae91609000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788845483.908261:0:12972:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff92aeb4d499b8) has exports, disconnecting them 00000020:00080000:1.0:1788845483.908267:0:12972:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff92ae91609000), last request at 1788845300 00000020:00000080:1.0:1788845483.908272:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9504 00000020:00080000:1.0:1788845483.908282:0:12972:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92ae91609000): rc 0 00000020:00000080:1.0:1788845483.908287:0:12972:0:(genops.c:885:class_export_put()) final put ffff92ae91609000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788845483.908312:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae90d91000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788845483.908887:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae91609000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788845483.930898:0:12972:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788845483.930908:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788845483.930914:0:12972:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788845483.930937:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788845483.931125:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788845483.931135:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788845483.931144:0:12972:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ae90de3800 1 00000020:00000080:0.0:1788845483.931151:0:12972:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df942b 00000020:00000080:0.0:1788845483.931161:0:12972:0:(genops.c:885:class_export_put()) final put ffff92ae90d96800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788845483.931166:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788845483.931171:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788845483.931175:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788845483.931179:0:12972:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff92ae917c3370) has no exports 00000020:00000080:3.0:1788845483.931546:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ae9160b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788845483.931554:0:36:0:(genops.c:885:class_export_put()) final put ffff92aeb4d6f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788845483.931558:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb4d6f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788845483.931567:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788845483.931644:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae90d96800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788845484.016270:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788845484.016286:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788845484.016293:0:12972:0:(genops.c:885:class_export_put()) final put ffff92ae836a7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788845484.016298:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae836a7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788845484.016306:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788845484.016473:0:12972:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92ae90cb9000 00000020:01000000:3.0:1788845484.016498:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788845484.016503:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788845484.016508:0:12972:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788845484.016513:0:12972:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff92ae917c0000) has no exports 00000100:00100000:3.0:1788845484.016665:0:8176:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff92ae986f9e00:8176] 4 exiting: rc = 0 00000100:00100000:3.0:1788845484.016791:0:7234:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff92ae8fe67000:7234] 3 exiting: rc = 0 00000100:00100000:1.0:1788845484.018252:0:5817:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff92aea67e5000:5817] 0 exiting: rc = 1 00000100:00100000:2.0:1788845484.018309:0:5818:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff92aea67e4c00:5818] 1 exiting: rc = 0 00000100:00100000:2.0:1788845484.019182:0:5819:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff92aeb9584400:5819] 2 exiting: rc = 0 00000100:00100000:3.0:1788845484.019918:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.019929:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.019936:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.019942:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.019949:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.019955:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.019963:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.019982:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.019988:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.019995:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020001:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020007:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020024:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020031:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020038:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020044:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020051:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020057:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020062:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020069:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020076:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020081:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020088:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020106:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020113:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020119:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020126:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020134:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020140:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020146:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020153:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020162:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020169:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020175:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020182:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020188:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020194:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020200:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020207:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020213:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020219:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020225:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020239:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020245:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020251:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020257:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020263:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020269:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020275:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020283:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020289:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020296:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020302:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020321:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020328:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020334:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020340:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020347:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020353:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020384:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020393:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020402:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020413:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.020425:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845484.027266:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff92ae90d1f000:5821] 1 exiting: rc = 0 00000100:00100000:1.0:1788845484.027427:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff92aea1de6000:5820] 0 exiting: rc = 1 00000100:00100000:3.0:1788845484.027617:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027626:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027634:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027641:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027648:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027653:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027659:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027665:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027672:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027679:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027689:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027780:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027791:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027805:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027815:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027825:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027831:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027838:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027845:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027850:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027856:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027861:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027866:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027872:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027877:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027883:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027888:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027892:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027898:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027904:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027909:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027921:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027927:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027933:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027938:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027944:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027949:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027955:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027960:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027965:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027970:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027975:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027980:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027985:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027990:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.027996:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028001:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028007:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028021:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028026:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028032:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028037:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028043:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028048:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028053:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028059:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028064:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028069:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028074:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028079:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028084:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028090:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028096:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.028103:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845484.029229:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff92aea67e5600:5822] 0 exiting: rc = 1 00000100:00100000:0.0:1788845484.029250:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff92ae8fdd3400:5823] 1 exiting: rc = 0 00000100:00100000:3.0:1788845484.029852:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029860:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029867:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029873:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029880:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029887:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029894:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029901:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029908:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029926:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029934:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029940:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029948:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029955:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029961:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029968:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029974:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029980:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.029988:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030004:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030011:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030034:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030041:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030051:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030057:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030066:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030073:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030081:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030089:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030096:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030104:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030112:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030120:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030140:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030148:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030155:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030161:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030168:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030175:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030181:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030188:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030195:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030202:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030208:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030214:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030234:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030241:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030248:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030256:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030263:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030269:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.030276:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031073:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031091:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031106:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031113:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031119:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031146:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031153:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031160:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031167:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031175:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031182:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.031189:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845484.043237:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff92aea666a400:5824] 0 exiting: rc = 1 00000100:00100000:0.0:1788845484.043693:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff92ae8fdd3c00:5825] 1 exiting: rc = 0 00000100:00100000:3.0:1788845484.043902:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043910:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043916:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043921:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043926:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043932:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043936:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043941:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043947:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043951:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043957:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043962:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043968:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043973:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043978:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043982:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043987:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043992:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.043997:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044002:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044006:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044011:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044015:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044020:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044025:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044040:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044045:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044050:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044059:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044066:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044072:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044077:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044082:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044086:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044092:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044097:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044102:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044107:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044112:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044116:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044121:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044125:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044129:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044133:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044137:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044141:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044187:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044194:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044199:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044203:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044207:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044212:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044216:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044220:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044225:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044229:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044233:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044238:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044242:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044247:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044257:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044262:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044267:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.044272:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845484.047188:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff92aea666ae00:5827] 1 exiting: rc = 0 00000100:00100000:0.0:1788845484.047338:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff92ae8fdd3800:5826] 0 exiting: rc = 1 00000100:00100000:3.0:1788845484.047664:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047674:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047680:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047686:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047692:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047698:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047713:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047718:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047724:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047729:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047733:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047738:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047743:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047748:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047752:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047757:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047762:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047767:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047780:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047786:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047790:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047795:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047800:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047805:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047809:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047814:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047819:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047823:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047828:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047833:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047838:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047854:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047860:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047865:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047871:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047878:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047885:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047891:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047897:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047909:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047914:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047918:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047924:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047928:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047932:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047937:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047942:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047947:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047952:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047956:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047961:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047965:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047969:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047973:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047978:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047983:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047988:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047993:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.047997:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048002:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048006:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048010:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048014:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048134:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845484.048621:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff92ae8f8bf600:5828] 0 exiting: rc = 1 00000100:00100000:0.0:1788845484.048621:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff92ae8f8be600:5829] 1 exiting: rc = 0 00000100:00100000:3.0:1788845484.048683:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048689:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048711:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048716:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048721:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048726:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048731:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048735:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048741:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048751:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048762:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048767:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048781:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048788:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048793:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048799:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048804:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048809:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048819:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048825:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048830:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048835:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048844:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048852:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048857:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048863:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048871:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048877:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048885:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048891:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048896:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048904:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048910:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048918:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048924:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048930:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048939:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048955:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048961:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048967:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048976:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048985:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048990:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.048995:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049002:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049010:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049016:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049030:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049036:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049041:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049050:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049056:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049064:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049070:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049075:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049150:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049158:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049163:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049172:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049177:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049182:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049191:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049196:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.049205:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845484.050414:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff92ae8fcdc000:5830] 0 exiting: rc = 1 00000100:00100000:1.0:1788845484.050656:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff92aebbcb4000:5832] 2 exiting: rc = 0 00000100:00100000:0.0:1788845484.054617:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff92aebbcb4200:5831] 1 exiting: rc = 0 00000100:00100000:3.0:1788845484.055134:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055144:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055150:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055156:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055182:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055188:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055204:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055210:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055225:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055230:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055236:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055242:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055248:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055253:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055259:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055264:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055269:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055275:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055280:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055285:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055290:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055296:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055302:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055307:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055312:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055317:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055323:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055328:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055343:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055350:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055356:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055379:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055386:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055392:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055398:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055407:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055413:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055419:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.055425:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056016:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056028:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056033:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056039:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056052:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056058:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056063:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056069:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056075:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056080:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056085:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056091:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056096:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056116:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056123:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056129:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056134:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056139:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056144:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056150:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056155:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056161:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056165:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056171:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845484.056178:0:12972:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788845484.064095:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788845484.064114:0:12972:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788845484.064121:0:12972:0:(genops.c:885:class_export_put()) final put ffff92ae90cbc800/MDS_uuid 00000020:00000080:3.0:1788845484.064126:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae90cbc800/MDS_uuid for MDS 00000020:01000000:3.0:1788845484.064137:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788845484.064276:0:12972:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788845484.891540:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845485.916031:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788845486.504473:0:13125:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788845486.517101:0:13125:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788845486.517151:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.517166:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.517173:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.517180:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.517206:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788845486.517212:0:13125:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788845486.517234:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788845486.517238:0:13125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788845486.517243:0:13125:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788845486.517249:0:13125:0:(import.c:65:import_set_state_nolock()) ffff92aead935800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788845486.517253:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788845486.517255:0:13125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788845486.517274:0:13125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788845486.517511:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845486.517519:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845486.517527:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a400 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:0.0:1788845486.517531:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845486.517540:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845486.517548:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845486.517554:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788845486.517556:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788845486.517564:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788845486.517620:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845486.517627:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788845486.517680:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788845486.517701:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845486.517710:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6df978f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df9796 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845486.517727:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845486.517729:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845486.517731:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845486.518108:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.518118:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.518124:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.518130:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.518147:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788845486.518154:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.518160:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.518167:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.518172:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845486.518189:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788845486.518192:0:13125:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788845486.518207:0:13125:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788845486.518211:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788845486.518215:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788845486.518228:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788845486.518235:0:13125:0:(genops.c:1819:print_export_data()) lustre-OST0000: UNLINKED ffff92ae885b5000 lustre-MDT0000-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967310 stale:0 00000020:00080000:1.0:1788845486.518241:0:13125:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff92aeb7724d28) has no exports 00000020:00080000:1.0:1788845486.518265:0:13125:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff92aeb7724d28) has no exports 00010000:00010000:3.0:1788845486.518282:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845486.518297:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845486.518311:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1e000 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:3.0:1788845486.518316:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845486.518345:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845486.518354:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845486.518389:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788845486.518394:0:5806:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788845486.518397:0:5806:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788845486.518436:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845486.518443:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845486.518471:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845486.518479:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e000/0xd8041b54d6df979d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df97a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845486.518495:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845486.518500:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845486.518507:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08200 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:3.0:1788845486.518511:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845486.518519:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845486.518537:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845486.518542:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788845486.518545:0:5806:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788845486.518547:0:5806:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788845486.518564:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845486.518570:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845486.518577:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845486.518584:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08200/0xd8041b54d6df999c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd8041b54d6df99a3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845486.518594:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845486.518596:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845486.518598:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845486.518630:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189600128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845486.518711:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845486.518789:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845486.518796:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189600256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845486.518938:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845486.518979:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189600128 00000100:00100000:3.0:1788845486.518988:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189600128 00000100:00100000:3.0:1788845486.519029:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189600256 00000100:00100000:3.0:1788845486.519033:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189600256 00000100:00100000:3.0:1788845486.519067:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788845486.519083:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc682d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1875740189600128:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788845486.519092:0:5802:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788845486 with bad export cookie 15565596263295456341 00010000:00010000:0.0:1788845486.519348:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845486.519396:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788845486.519405:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e843c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3283:x1875740189600256:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788845486.519412:0:8419:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788845486 with bad export cookie 15565596263295456341 00000100:00100000:0.0:1788845486.519499:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e843c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3283:x1875740189600256:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (561us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788845486.519506:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788845486.519553:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.135@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788845486.519557:0:3283:0:(import.c:65:import_set_state_nolock()) ffff92ae8fca9800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788845486.519560:0:3283:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788845486.540148:0:3283:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.135@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788845486.540155:0:3283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788845486.540165:0:3283:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92aebc680a80 x1875740189600128/t0(0) o103->MGC192.168.206.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788845502 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845486.540178:0:3283:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92aebc683480 x1875740189600256/t0(0) o103->MGC192.168.206.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788845502 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788845486.540246:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00100000:2.0:1788845486.540249:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:0:1875740189600000:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788845486.540250:0:3283:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788845486.540252:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788845486.540258:0:3283:0:(import.c:65:import_set_state_nolock()) ffff92ae8fca9800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788845486.540266:0:3283:0:(import.c:510:import_select_connection()) MGC192.168.206.135@tcp: connect to NID 0@lo last attempt 108 00000100:00080000:0.0:1788845486.540276:0:3283:0:(import.c:624:import_select_connection()) MGC192.168.206.135@tcp: import ffff92ae8fca9800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:0.0:1788845486.540596:0:3283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aeadc85180 x1875740189600384/t0(0) o250->MGC192.168.206.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788845486.540725:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3282:1875740189600384:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788845486.540786:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875740189600384 offset 0 length 520: 4 00000100:00100000:0.0:1788845486.540894:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189600128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845486.540909:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3283:1875740189600256:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1788845486.548025:0:5802:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875740189600128 offset 224 length 224: 4 00000100:00100000:3.0:1788845486.548058:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc682d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1875740189600128:12345-0@lo:103:ldlm_bl.0 Request processed in 28973us (29346us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788845486.548071:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000001:00100000:3.0:1788845486.740406:0:6682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788845486.740415:0:6682:0:(genops.c:885:class_export_put()) final put ffff92ae885b5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788845486.740585:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae885b5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788845486.740639:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ae885b7800 for lustre-OST0000 00010000:00010000:3.0:1788845486.939619:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788845487.195518:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788845487.195531:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788845487.195534:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788845487.195538:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788845487.195542:0:8:0:(import.c:65:import_set_state_nolock()) ffff92ad819a0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788845487.195550:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 291 00000100:00080000:3.0:1788845487.195556:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788845487.195564:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92ad819a0800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1788845487.195611:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aebc681c00 x1875740189600512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788845487.195770:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875740189600512:0@lo:38:kworker.0 00000400:00000100:1.0:1788845487.195825:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740189600512 offset 0 length 520: 4 00010000:00010000:0.0:1788845487.963533:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788845488.541963:0:13125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92aeb7b6f960 - data ffff92aeb7ca51b0/ffff92aeb7e1d000 00000020:01000000:1.0:1788845488.542099:0:13125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ae8fd5b060 - data ffff92aea9b6d6c0/ffff92aeb765b800 00100000:10000000:1.0:1788845488.554322:0:13125:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788845488.580920:0:13125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9589 00000020:00000080:1.0:1788845488.580931:0:13125:0:(genops.c:885:class_export_put()) final put ffff92aeb76a8800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788845488.581019:0:13125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92ae8fcc6800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788845488.581023:0:13125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ae8fcc6800 2 00000020:01000004:1.0:1788845488.581027:0:13125:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92ae8fcc6800 from lustre-OST0000 00000020:00000080:1.0:1788845488.581054:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788845488.581064:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788845488.581068:0:13125:0:(genops.c:885:class_export_put()) final put ffff92aeb76a9000/lustre-OST0000_UUID 00000020:00000080:1.0:1788845488.581072:0:13125:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb76a9000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788845488.581080:0:13125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788845488.581131:0:13125:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788845488.581136:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788845488.581140:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788845488.581145:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788845488.581152:0:13125:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff92aeb76ae800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788845488.581159:0:13125:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff92aeb77219b8) has exports, disconnecting them 00000020:00080000:1.0:1788845488.581164:0:13125:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff92aeb76ae800), last request at 1788845314 00000020:00000080:1.0:1788845488.581182:0:13125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df95b3 00000020:00080000:1.0:1788845488.581197:0:13125:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92aeb76ae800): rc 0 00000020:00000080:1.0:1788845488.581201:0:13125:0:(genops.c:885:class_export_put()) final put ffff92aeb76ae800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788845488.581719:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb76a8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788845488.581733:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb76ae800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788845488.582314:0:13125:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788845488.582319:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788845488.582325:0:13125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788845488.582331:0:13125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788845488.582701:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788845488.582709:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788845488.582715:0:13125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ae8fcc6800 1 00000020:00000080:1.0:1788845488.582720:0:13125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9543 00000020:00000080:1.0:1788845488.582727:0:13125:0:(genops.c:885:class_export_put()) final put ffff92aeae478000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788845488.583188:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92aead935800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788845488.583200:0:8:0:(genops.c:885:class_export_put()) final put ffff92aeb76ad800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788845488.583203:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb76ad800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788845488.583209:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788845488.583327:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788845488.583333:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788845488.583338:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788845488.583342:0:13125:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff92aeb4d4b370) has no exports 00000020:00000080:2.0:1788845488.583484:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae478000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788845488.626459:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788845488.626475:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788845488.626481:0:13125:0:(genops.c:885:class_export_put()) final put ffff92ae8fcc2800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788845488.626486:0:13125:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae8fcc2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788845488.626499:0:13125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788845488.626839:0:13125:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92ae8fcc3800 00000020:02000400:0.0:1788845488.626966:0:13125:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788845488.991122:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845490.011497:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788845490.885673:0:13277:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788845490.895548:0:13277:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788845490.895646:0:13277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.895686:0:13277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.895694:0:13277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.895702:0:13277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.895718:0:13277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788845490.895723:0:13277:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1788845490.895729:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845490.895746:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845490.895754:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52200 already unused, calling callback (ffffffffc1bfac20) 00000100:00080000:2.0:1788845490.895758:0:13277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:3.0:1788845490.895763:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845490.895767:0:13277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92aebc681c00 x1875740189600512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788845502 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788845490.895772:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845490.895778:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845490.895781:0:13277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 10000000:01000000:3.0:1788845490.895784:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788845490.895786:0:8418:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:2.0:1788845490.895786:0:13277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 10000000:01000000:3.0:1788845490.895789:0:8418:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:2.0:1788845490.895791:0:13277:0:(import.c:65:import_set_state_nolock()) ffff92ad819a0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788845490.895796:0:13277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788845490.895799:0:13277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92aebc681c00 x1875740189600512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788845502 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788845490.895800:0:8418:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92ae8fca9800 00010000:00010000:3.0:1788845490.895804:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845490.895806:0:13277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788845490.895809:0:13277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:3.0:1788845490.895811:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae89a52200/0xd8041b54d6df9765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd8041b54d6df976c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845490.895821:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845490.895822:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845490.895824:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845490.895886:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875740189600512:0@lo:38:kworker.0 00010000:00010000:2.0:1788845490.896783:0:13277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.896796:0:13277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.896816:0:13277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.896822:0:13277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.896842:0:13277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788845490.896849:0:13277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.896855:0:13277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.896861:0:13277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.896867:0:13277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845490.896876:0:13277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788845490.896880:0:13277:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788845490.896901:0:13277:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788845490.896905:0:13277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788845490.896909:0:13277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788845490.896915:0:13277:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788845490.896919:0:13277:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff92aebc7b19b8) has no exports 00000020:00080000:2.0:1788845490.896942:0:13277:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff92aebc7b19b8) has no exports 00010000:00010000:3.0:1788845490.896997:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845490.897003:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845490.897011:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81480e00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:3.0:1788845490.897014:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845490.897022:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845490.897036:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845490.897042:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788845490.897044:0:5806:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788845490.897046:0:5806:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788845490.897056:0:5806:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92ae8fca9800 00010000:00010000:3.0:1788845490.897059:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845490.897065:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae81480e00/0xd8041b54d6df9773 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd8041b54d6df977a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845490.897078:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845490.897081:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845490.897087:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b600 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:3.0:1788845490.897090:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845490.897097:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845490.897103:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845490.897108:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788845490.897110:0:5806:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788845490.897116:0:5806:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788845490.897122:0:5806:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92ae8fca9800 00010000:00010000:3.0:1788845490.897125:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845490.897131:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aeb748b600/0xd8041b54d6df998e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd8041b54d6df9995 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845490.897143:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845490.897145:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845490.897147:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845490.897634:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788845490.900164:0:13277:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92aeb7b6fba0 - data ffff92aeb7ca5e58/ffff92aeb7e1ec00 00000020:01000000:2.0:1788845490.900629:0:13277:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92aebc8dc540 - data ffff92aeb7ddaca8/ffff92aeb75fc800 00100000:10000000:2.0:1788845490.914865:0:13277:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788845490.935334:0:13277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9654 00000020:00000080:0.0:1788845490.935346:0:13277:0:(genops.c:885:class_export_put()) final put ffff92aeb95b5800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788845490.935568:0:13277:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92aeb79e4000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788845490.935572:0:13277:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92aeb79e4000 2 00000020:01000004:0.0:1788845490.935576:0:13277:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92aeb79e4000 from lustre-OST0001 00000020:00000080:0.0:1788845490.935602:0:13277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788845490.935613:0:13277:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788845490.935617:0:13277:0:(genops.c:885:class_export_put()) final put ffff92aeb95b3800/lustre-OST0001_UUID 00000020:00000080:0.0:1788845490.935620:0:13277:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb95b3800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788845490.935643:0:13277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788845490.935786:0:13277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6->MGS 00010000:00010000:0.0:1788845490.935802:0:13277:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae81480800/0xd8041b54d6df9566 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df956d expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845490.935814:0:13277:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae81480800/0xd8041b54d6df9566 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df956d expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845490.935821:0:13277:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788845490.935824:0:13277:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788845490.935827:0:13277:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788845490.935842:0:13277:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92ae8fca9800 00010000:00010000:0.0:1788845490.935845:0:13277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae81480800/0xd8041b54d6df9566 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd8041b54d6df956d expref: -99 pid: 6654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845490.935859:0:13277:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae89a53a00/0xd8041b54d6df97e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd8041b54d6df97ea expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845490.935866:0:13277:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae89a53a00/0xd8041b54d6df97e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd8041b54d6df97ea expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845490.935871:0:13277:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788845490.935874:0:13277:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788845490.935876:0:13277:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788845490.935885:0:13277:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92ae8fca9800 00010000:00010000:0.0:1788845490.935888:0:13277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae89a53a00/0xd8041b54d6df97e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd8041b54d6df97ea expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788845490.935906:0:13277:0:(import.c:65:import_set_state_nolock()) ffff92ae8fca9800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788845490.935910:0:13277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788845490.935912:0:13277:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788845490.935925:0:13277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788845490.935929:0:13277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788845490.935977:0:13277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92aeadc85180 x1875740189600384/t0(0) o250->MGC192.168.206.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788845496 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788845490.935996:0:13277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788845490.935999:0:13277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:3.0:1788845490.936064:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6:3282:1875740189600384:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1788845490.936105:0:13277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788845490.936113:0:13277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9447 00000020:00000080:0.0:1788845490.936117:0:13277:0:(genops.c:885:class_export_put()) final put ffff92ae90cbc000/e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6 00000020:00000080:1.0:1788845490.936145:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb95b5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788845490.936333:0:13277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.135@tcp (flags='') 00000020:00000080:0.0:1788845490.936339:0:13277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788845490.936345:0:13277:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.135@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788845490.936349:0:13277:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff92ae8ff0cd28) has no exports 10000000:01000000:3.0:1788845490.936443:0:5814:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788845490.936512:0:13277:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.135@tcp: client import never connected 00000100:00080000:0.0:1788845490.936515:0:13277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788845490.936517:0:13277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788845490.936520:0:13277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788845490.936522:0:13277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788845490.936723:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae90cbc000/e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6 for MGC192.168.206.135@tcp 00000020:00000080:0.0:1788845490.936841:0:13277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788845490.936847:0:13277:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.135@tcp (uuid e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6) 00000020:01000000:0.0:1788845490.936856:0:13277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788845490.936860:0:13277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788845490.936863:0:13277:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788845490.936896:0:13277:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff92ad819a2000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788845490.936902:0:13277:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff92aeb7720000) has exports, disconnecting them 00000020:00080000:0.0:1788845490.936906:0:13277:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff92ad819a2000), last request at 1788845335 00000020:00000080:0.0:1788845490.936910:0:13277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df967e 00000020:00080000:0.0:1788845490.936923:0:13277:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92ad819a2000): rc 0 00000020:00000080:0.0:1788845490.936926:0:13277:0:(genops.c:885:class_export_put()) final put ffff92ad819a2000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788845490.936949:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ae8fca9800 for MGC192.168.206.135@tcp 00000020:00000080:1.0:1788845490.936955:0:38:0:(genops.c:885:class_export_put()) final put ffff92ae8fcab800/e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6 00000020:00000080:1.0:1788845490.936958:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92ae8fcab800/e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6 for MGC192.168.206.135@tcp 00000020:01000000:1.0:1788845490.936963:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.135@tcp (e857cf33-0a6e-4cd3-8dd8-cb4adb07dfc6) 00000020:00000080:1.0:1788845490.937788:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92ad819a2000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788845490.940584:0:13277:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788845490.940596:0:13277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788845490.940600:0:13277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788845490.940610:0:13277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788845490.941184:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ad819a0800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788845490.942450:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788845490.942728:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788845490.942918:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1788845490.943038:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788845490.943197:0:7601:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff92aeb7e25a00:7601] 2 exiting: rc = 0 00000100:00100000:1.0:1788845490.943393:0:5800:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff92aeb9585000:5800] 0 exiting: rc = 1 00000100:00100000:1.0:1788845490.944657:0:5801:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff92aeb9584c00:5801] 1 exiting: rc = 0 00000100:00100000:3.0:1788845490.945113:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.945435:0:5802:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff92ae86453400:5802] 0 exiting: rc = 1 00000100:00100000:2.0:1788845490.945551:0:5803:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff92ae86453e00:5803] 1 exiting: rc = 0 00000100:00100000:2.0:1788845490.945870:0:6672:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff92aead92b400:6672] 3 exiting: rc = 0 00000100:00100000:2.0:1788845490.945929:0:5804:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff92ae86452e00:5804] 2 exiting: rc = 0 00000100:00100000:1.0:1788845490.946450:0:8419:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff92aebc31d600:8419] 4 exiting: rc = 0 00000100:00100000:3.0:1788845490.946687:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946695:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946701:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946707:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946712:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946718:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946723:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946728:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946734:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946751:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946758:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946764:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946770:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946775:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946795:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946801:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946806:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946853:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946859:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946864:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946870:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946876:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946882:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946888:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946893:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946899:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946905:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946911:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946917:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946932:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946940:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946949:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946956:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946962:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946969:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946975:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946981:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946987:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946992:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.946997:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947003:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947008:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947014:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947019:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947025:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947030:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947035:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947042:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947047:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947060:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947065:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947071:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947076:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947082:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947087:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947092:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947097:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947102:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947284:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947292:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947298:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947305:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947311:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.947317:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788845490.949344:0:13277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788845490.949357:0:13277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788845490.949391:0:13277:0:(genops.c:885:class_export_put()) final put ffff92aebc8d5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788845490.949396:0:13277:0:(genops.c:844:class_export_destroy()) destroying export ffff92aebc8d5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788845490.949562:0:13277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788845490.949613:0:13277:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92aeb79e4000 1 00000020:00000080:3.0:1788845490.949620:0:13277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd8041b54d6df9623 00000020:00000080:3.0:1788845490.949627:0:13277:0:(genops.c:885:class_export_put()) final put ffff92aeb79e7000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788845490.949647:0:13277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788845490.949652:0:13277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788845490.949658:0:13277:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788845490.949661:0:13277:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff92aeb7723370) has no exports 00000020:00000080:1.0:1788845490.949997:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb79e7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788845490.961015:0:13277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788845490.961034:0:13277:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788845490.961040:0:13277:0:(genops.c:885:class_export_put()) final put ffff92aeb79e1000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788845490.961045:0:13277:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeb79e1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788845490.961052:0:13277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788845490.961252:0:13277:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92aeb79e3800 00000020:01000000:3.0:1788845490.961289:0:13277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788845490.961293:0:13277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788845490.961298:0:13277:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788845490.961302:0:13277:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff92aeae5119b8) has no exports 00000020:00000080:3.0:1788845490.961327:0:13277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788845490.961846:0:13277:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788845490.961851:0:13277:0:(genops.c:885:class_export_put()) final put ffff92aeae47d800/OSS_uuid 00000020:00000080:3.0:1788845490.961854:0:13277:0:(genops.c:844:class_export_destroy()) destroying export ffff92aeae47d800/OSS_uuid for OSS 00000020:01000000:3.0:1788845490.961860:0:13277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788845490.961902:0:5813:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788845490.962097:0:12028:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff92ae9a3de600:12028] 3 exiting: rc = 0 00000100:00100000:3.0:1788845490.962159:0:6658:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff92aeae25f600:6658] 1 exiting: rc = 0 00000100:00100000:3.0:1788845490.963528:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff92aeb3e05200:6659] 2 exiting: rc = 0 00000100:00100000:3.0:1788845490.963645:0:6656:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff92aeae25fc00:6656] 0 exiting: rc = 1 00000100:00100000:1.0:1788845490.976186:0:12534:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff92aebc6ca000:12534] 4 exiting: rc = 0 00000100:00100000:3.0:1788845490.978528:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978540:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978549:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978554:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978560:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978565:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978571:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978576:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978581:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978586:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978834:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978843:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978848:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978853:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978858:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978863:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978869:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978874:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978879:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978885:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978909:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978916:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978922:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978929:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978937:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978945:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978950:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978955:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978960:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978966:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978971:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978978:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978983:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978989:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978994:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.978999:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979005:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979012:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979017:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979023:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979028:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979034:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979046:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979052:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979057:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979062:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979067:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979073:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979078:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979084:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979089:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979094:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979100:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979107:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979113:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979128:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979135:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979143:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979151:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979158:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979167:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979175:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979185:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788845490.979191:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.981339:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff92aeb3e05c00:6660] 0 exiting: rc = 1 00000100:00100000:2.0:1788845490.981606:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff92aeb3e04000:6661] 1 exiting: rc = 0 00000100:00100000:0.0:1788845490.981691:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981699:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981718:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981723:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981728:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981733:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981749:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981755:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981761:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981767:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981772:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981777:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981782:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981787:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981792:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981798:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981803:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981808:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981813:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981818:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981824:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981829:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981835:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981842:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981847:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981852:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981858:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981863:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981869:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981874:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981890:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981896:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981902:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981907:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981914:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981920:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981935:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981950:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981955:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981961:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981966:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981976:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981983:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.981998:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982005:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982010:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982022:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982028:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982035:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982041:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982046:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982051:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982055:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982061:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982065:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982070:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982075:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982081:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982086:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982092:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982098:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982103:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982108:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.982115:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845490.987321:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff92aead926e00:6662] 0 exiting: rc = 1 00000100:00100000:3.0:1788845490.988235:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff92ae90d06000:6664] 2 exiting: rc = 0 00000100:00100000:2.0:1788845490.988828:0:6663:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff92aeb3e04800:6663] 1 exiting: rc = 0 00000100:00100000:1.0:1788845490.989004:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989012:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989018:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989025:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989032:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989038:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989044:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989051:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989057:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989063:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989069:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989074:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989081:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989088:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989094:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989102:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989108:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989113:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989120:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989127:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989153:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989161:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989167:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989187:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989194:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989201:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989207:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989215:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989222:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989228:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989235:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989242:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989248:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989254:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989260:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989266:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989273:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989279:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989285:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989290:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989296:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989303:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989309:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989315:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989900:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989910:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989916:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989923:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989930:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989936:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989942:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989949:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989955:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989962:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989968:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989974:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989981:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.989987:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.990001:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.990007:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.990013:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.990018:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.990025:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788845490.990031:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001478:0:6666:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff92ae90d06400:6666] 1 exiting: rc = 0 00000100:00100000:2.0:1788845491.001799:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff92aeb3ca5400:6665] 0 exiting: rc = 1 00000100:00100000:0.0:1788845491.001897:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001904:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001910:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001915:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001920:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001925:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001947:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001952:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001957:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001962:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001967:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001972:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001977:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001983:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001988:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001993:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.001999:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002003:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002008:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002013:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002019:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002026:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002031:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002036:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002040:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002045:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002051:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002056:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002061:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002066:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002071:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002076:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002081:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002087:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002091:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002096:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002101:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002106:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002111:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002116:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002122:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002136:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002142:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002149:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002154:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002159:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002164:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002170:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002175:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002181:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002186:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002193:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002199:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002205:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002210:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002216:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002222:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002227:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002232:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002237:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002241:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002246:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002250:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.002255:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788845491.005024:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff92ae8302b600:6667] 0 exiting: rc = 1 00000100:00100000:2.0:1788845491.005134:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff92ae984f5000:6668] 1 exiting: rc = 0 00000100:00100000:0.0:1788845491.005254:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005269:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005277:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005283:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005289:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005295:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005300:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005306:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005312:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005318:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005335:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005342:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005386:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005395:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005411:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005417:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005423:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005429:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005435:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005441:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005447:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005452:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005472:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005480:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005485:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005491:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005496:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005502:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005508:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005514:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005520:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005526:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005533:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005538:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005559:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005567:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005573:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005579:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005585:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005604:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005612:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005618:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005625:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005631:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005637:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005643:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005665:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005682:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005688:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005693:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005699:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005704:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005709:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005715:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005722:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005728:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005745:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005752:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005772:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005779:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005785:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005790:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005795:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788845491.005802:0:13277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788845491.020528:0:13277:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788845504.449750:0:13892:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788845511.591155:0:14355:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788845511.591161:0:14355:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788845511.591292:0:14355:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92aeadcb1000 00000020:01000004:2.0:1788845511.591623:0:14355:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788845511.591642:0:14355:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788845511.591659:0:14355:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff92ae8ff0b370) 00000020:00000080:2.0:1788845511.591674:0:14355:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788845511.613825:0:14355:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788845511.619526:0:14355:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788845511.620207:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 427: rc = 0 00100000:10000000:2.0:1788845511.620306:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 427: rc = 0 00100000:10000000:2.0:1788845511.620434:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 427: rc = 0 00100000:10000000:2.0:1788845511.620531:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 427: rc = 0 00100000:10000000:2.0:1788845511.621097:0:14355:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788845511.621177:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 427: rc = 0 00100000:10000000:2.0:1788845511.621284:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 427: rc = 0 00100000:10000000:2.0:1788845511.621772:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 429: rc = 0 00100000:10000000:3.0:1788845511.631253:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 567: rc = 0 00100000:10000000:3.0:1788845511.631731:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 567: rc = 0 00100000:10000000:3.0:1788845511.632750:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 777: rc = 0 00100000:10000000:3.0:1788845511.633795:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 777: rc = 0 00100000:10000000:3.0:1788845511.635824:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 777: rc = 0 00100000:10000000:3.0:1788845511.636808:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 777: rc = 0 00100000:10000000:3.0:1788845511.637338:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 777: rc = 0 00100000:10000000:3.0:1788845511.637964:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 777: rc = 0 00100000:10000000:3.0:1788845511.644178:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 777: rc = 0 00100000:10000000:3.0:1788845511.644502:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 777: rc = 0 00100000:10000000:3.0:1788845511.644783:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 777: rc = 0 00100000:10000000:3.0:1788845511.645045:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 777: rc = 0 00100000:10000000:3.0:1788845511.645290:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 777: rc = 0 00100000:10000000:1.0:1788845511.646967:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 777: rc = 0 00100000:10000000:1.0:1788845511.648287:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 182: rc = 0 00100000:10000000:1.0:1788845511.648577:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 182: rc = 0 00100000:10000000:1.0:1788845511.648838:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 182: rc = 0 00100000:10000000:1.0:1788845511.649284:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 182: rc = 0 00100000:10000000:1.0:1788845511.649660:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 182: rc = 0 00100000:10000000:1.0:1788845511.649972:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 182: rc = 0 00100000:10000000:1.0:1788845511.650431:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 182: rc = 0 00100000:10000000:1.0:1788845511.650721:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 182: rc = 0 00100000:10000000:1.0:1788845511.653477:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 182: rc = 0 00100000:10000000:1.0:1788845511.653807:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 182: rc = 0 00100000:10000000:1.0:1788845511.657720:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 182: rc = 0 00100000:10000000:1.0:1788845511.660661:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 182: rc = 0 00100000:10000000:1.0:1788845511.660979:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 182: rc = 0 00100000:10000000:1.0:1788845511.661271:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 182: rc = 0 00100000:10000000:1.0:1788845511.662845:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 182: rc = 0 00100000:10000000:1.0:1788845511.663326:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 182: rc = 0 00100000:10000000:1.0:1788845511.663591:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 182: rc = 0 00100000:10000000:1.0:1788845511.663859:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 182: rc = 0 00100000:10000000:1.0:1788845511.664853:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 182: rc = 0 00100000:10000000:1.0:1788845511.667564:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 182: rc = 0 00100000:10000000:1.0:1788845511.667869:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 182: rc = 0 00100000:10000000:1.0:1788845511.669432:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 182: rc = 0 00100000:10000000:1.0:1788845511.669818:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 182: rc = 0 00100000:10000000:1.0:1788845511.670228:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 182: rc = 0 00100000:10000000:1.0:1788845511.672734:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 182: rc = 0 00100000:10000000:1.0:1788845511.674607:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 182: rc = 0 00100000:10000000:1.0:1788845511.675419:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 182: rc = 0 00100000:10000000:1.0:1788845511.675706:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 182: rc = 0 00100000:10000000:1.0:1788845511.676427:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 182: rc = 0 00100000:10000000:1.0:1788845511.676703:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 182: rc = 0 00100000:10000000:1.0:1788845511.677813:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 182: rc = 0 00100000:10000000:1.0:1788845511.678216:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 182: rc = 0 00100000:10000000:1.0:1788845511.678645:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 171: rc = 0 00100000:10000000:1.0:1788845511.679741:0:14355:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788845511.680309:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 568: rc = 0 00100000:10000000:1.0:1788845511.680572:0:14355:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788845511.680659:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 568: rc = 0 00100000:10000000:1.0:1788845511.680865:0:14355:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788845511.681018:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 568: rc = 0 00100000:10000000:1.0:1788845511.681530:0:14355:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788845511.681601:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 774: rc = 0 00100000:10000000:1.0:1788845511.681819:0:14355:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788845511.681892:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 774: rc = 0 00100000:10000000:1.0:1788845511.682352:0:14355:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788845511.682450:0:14355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 774: rc = 0 00000020:00000080:1.0:1788845511.682767:0:14355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788845511.682781:0:14355:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788845511.682793:0:14355:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6dfa748 00000020:01000004:1.0:1788845511.682801:0:14355:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788845511.682806:0:14355:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788845511.682812:0:14355:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92aeadcb1000 from MGS 00000020:01000004:1.0:1788845511.682817:0:14355:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788845511.682827:0:14355:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff92aeb7724d28) 00000020:00000080:1.0:1788845511.682837:0:14355:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788845511.682894:0:14355:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92aeadcb1000 from MGS, refs=2 00080000:01000000:1.0:1788845511.683412:0:14355:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788845511.683419:0:14355:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6dfa756 00000100:00100000:1.0:1788845511.683529:0:14355:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788845511.683686:0:14355:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788845511.683693:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788845511.684456:0:14355:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788845511.684464:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788845511.685202:0:14355:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788845511.685535:0:14355:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788845511.685541:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788845511.688437:0:14355:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788845511.688450:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788845511.690272:0:14355:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788845511.690284:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788845511.693195:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845511.693204:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845511.693206:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845511.693854:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845511.693858:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845511.693860:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845511.699714:0:14355:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788845511.702566:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788845511.714641:0:14355:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788845511.714664:0:14355:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788845511.714675:0:14355:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788845511.718197:0:14364:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788845511.718529:0:14355:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788845511.718906:0:14355:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788845511.719481:0:14355:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788845511.720118:0:14355:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845511.720303:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788845511.720309:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788845511.721442:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788845511.721453:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788845511.721968:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788845511.721975:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788845511.724383:0:14355:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788845511.724410:0:14355:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.135@tcp' 00000020:01000004:1.0:1788845511.724412:0:14355:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788845511.724445:0:14355:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.135@tcp (typ=mgc) 00000020:00000080:1.0:1788845511.724458:0:14355:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.135@tcp (ffff92aeb7723370) 00000020:00000080:1.0:1788845511.724473:0:14355:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788845511.724550:0:14355:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92aeb4235000@MGC192.168.206.135@tcp: add connection 192.168.206.135@tcp at head 00010000:00010000:1.0:1788845511.724789:0:14355:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.135@tcp-0 is initialized 00000040:01000000:1.0:1788845511.724797:0:14355:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788845511.726781:0:14369:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788845511.730523:0:14370:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788845511.730620:0:14355:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.135@tcp (uuid 4d9107f4-aa08-4701-832e-746d9df521c4) 00000020:00000080:2.0:1788845511.730665:0:14355:0:(genops.c:1385:class_connect()) connect: client 4d9107f4-aa08-4701-832e-746d9df521c4, cookie 0xd8041b54d6dfa764 00000100:00080000:2.0:1788845511.730681:0:14355:0:(import.c:510:import_select_connection()) MGC192.168.206.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788845511.730688:0:14355:0:(import.c:624:import_select_connection()) MGC192.168.206.135@tcp: import ffff92aeb4235000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:2.0:1788845511.730726:0:14355:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ad82f4ca80 x1875740189600640/t0(0) o250->MGC192.168.206.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788845511.730749:0:14355:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4d9107f4-aa08-4701-832e-746d9df521c4->MGS 00000020:01000004:2.0:1788845511.730774:0:14355:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788845511.730780:0:14355:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788845511.730796:0:14355:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff92ae8ff0cd28) 00000020:00000080:2.0:1788845511.730815:0:14355:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788845511.735248:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d9107f4-aa08-4701-832e-746d9df521c4:3282:1875740189600640:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788845511.735330:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845511.735545:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189600640 00000100:00100000:3.0:1788845511.735554:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189600640 00000100:00100000:3.0:1788845511.735585:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845511.735592:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1875740189600640:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788845511.735618:0:14366:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4d9107f4-aa08-4701-832e-746d9df521c4@0@lo t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:3.0:1788845511.735656:0:14366:0:(genops.c:1385:class_connect()) connect: client 4d9107f4-aa08-4701-832e-746d9df521c4, cookie 0xd8041b54d6dfa772 00000100:00080000:3.0:1788845511.735812:0:14366:0:(import.c:65:import_set_state_nolock()) ffff92ae82cb6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845511.735866:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+5:3282:x1875740189600640:12345-0@lo:250:mount.lustre.0 Request processed in 273us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845511.735874:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845511.735945:0:3282:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788845511.735954:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.135@tcp: connect to target with instance 0 00000100:00080000:3.0:1788845511.735962:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788845511.735967:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788845511.735970:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92aeb4235000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788845511.735973:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788845511.735990:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788845511.735995:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d9107f4-aa08-4701-832e-746d9df521c4:3282:1875740189600640:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788845511.743804:0:14355:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845511.744039:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788845511.744046:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788845511.747090:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788845511.747109:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788845511.753417:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788845511.753428:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788845511.754994:0:14355:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788845511.755187:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788845511.755199:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788845511.756066:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788845511.756075:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788845511.785001:0:14355:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845511.785246:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788845511.785252:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788845511.786848:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788845511.786861:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788845511.787578:0:14355:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845511.787769:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788845511.787775:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788845511.788272:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788845511.788285:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788845511.788865:0:14355:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845511.789015:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788845511.789020:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788845511.789745:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788845511.789753:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788845511.790313:0:14355:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845511.790644:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788845511.790649:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788845511.791053:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788845511.791060:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788845511.803958:0:14355:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845511.804206:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788845511.804212:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788845511.806684:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788845511.806701:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788845511.808232:0:14355:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788845511.808243:0:14355:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788845511.809269:0:14355:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788845511.809292:0:14355:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788845511.809299:0:14355:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788845511.809585:0:14355:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788845511.809619:0:14355:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.135@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788845511.809634:0:14355:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788845511.809636:0:14355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788845511.809638:0:14355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845511.809639:0:14355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845511.809641:0:14355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845511.809642:0:14355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845511.809644:0:14355:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788845511.809645:0:14355:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788845511.809736:0:14355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845511.809738:0:14355:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788845511.809741:0:14355:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788845511.809743:0:14355:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788845511.809745:0:14355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788845511.809746:0:14355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845511.809752:0:14355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845511.809753:0:14355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845511.809754:0:14355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845511.809755:0:14355:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788845511.809756:0:14355:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788845511.809757:0:14355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845511.809758:0:14355:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788845511.809784:0:14355:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788845511.809804:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189600768:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788845511.809876:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845511.809944:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae83fa9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788845511.809986:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189600768 00000100:00100000:3.0:1788845511.809992:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189600768 00000100:00100000:3.0:1788845511.810061:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845511.810070:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+5:14355:x1875740189600768:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788845511.810118:0:14368:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788845511.810122:0:14368:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788845511.810125:0:14368:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788845511.810486:0:14389:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788845511.810852:0:14368:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788845511.813343:0:14390:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788845511.813353:0:14390:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788845511.813356:0:14390:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788845511.813447:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788845511.813698:0:14368:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788845511.813711:0:14368:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788845511.822588:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+5:14355:x1875740189600768:12345-0@lo:253:mount.lustre.0 Request processed in 12506us (12698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845511.822604:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845511.822746:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189600768:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788845511.822762:0:14355:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788845511.822765:0:14355:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788845511.822767:0:14355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788845511.822769:0:14355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845511.822770:0:14355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845511.822771:0:14355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845511.822773:0:14355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845511.822774:0:14355:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788845511.822775:0:14355:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788845511.822777:0:14355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845511.822778:0:14355:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788845511.822796:0:14355:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92aeadcb1000 from lustre-MDT0000 10000000:01000000:2.0:1788845511.822827:0:14355:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788845511.822830:0:14355:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788845511.822835:0:14355:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff92aeb7723370 10000000:01000000:2.0:1788845511.822839:0:14355:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788845511.822847:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92aeb7723370 from 1 10000000:01000000:2.0:1788845511.822850:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788845511.822886:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.822897:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.822930:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845511.822951:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189600896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788845511.822988:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845511.823070:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae83fa96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845511.823116:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189600896 00000100:00100000:3.0:1788845511.823122:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189600896 00000100:00100000:3.0:1788845511.823197:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845511.823207:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+5:14355:x1875740189600896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788845511.823219:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845511.823234:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb748b600/0xd8041b54d6dfa780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa779 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845511.823256:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb748b600/0xd8041b54d6dfa780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa779 expref: 6 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845511.823266:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb748b600/0xd8041b54d6dfa780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa779 expref: 6 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845511.823397:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748b600, rc 0) 00000100:00100000:3.0:1788845511.823435:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+6:14355:x1875740189600896:12345-0@lo:101:mount.lustre.0 Request processed in 229us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845511.823441:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788845511.823514:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189600896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788845511.823529:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa780 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.823537:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa780 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845511.823585:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189601024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845511.823616:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.823800:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88ad0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845511.823843:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189601024 00000100:00100000:2.0:1788845511.823848:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189601024 00000100:00100000:2.0:1788845511.823870:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788845511.823877:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+6:14355:x1875740189601024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788845511.824156:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+6:14355:x1875740189601024:12345-0@lo:501:mount.lustre.0 Request processed in 279us (538us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788845511.824163:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845511.824252:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189601024:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788845511.824277:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788845511.824492:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa780 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.824501:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa780 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845511.824508:0:14355:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92aeadcb1000 10000000:01000000:0.0:1788845511.824512:0:14355:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788845511.824517:0:14355:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92aeadcb1000 10000000:01000000:0.0:1788845511.824519:0:14355:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788845511.824521:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92aeadcb1000 from 1 10000000:01000000:0.0:1788845511.824524:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788845511.824546:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ea00/0xd8041b54d6dfa787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.824554:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ea00/0xd8041b54d6dfa787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.824562:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ea00/0xd8041b54d6dfa787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845511.824575:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189601152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788845511.824601:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.824640:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88ad0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845511.824759:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189601152 00000100:00100000:1.0:1788845511.824764:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189601152 00000100:00100000:1.0:1788845511.824798:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788845511.824806:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+6:14355:x1875740189601152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788845511.824815:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845511.824826:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc08200/0xd8041b54d6dfa78e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa787 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.824842:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc08200/0xd8041b54d6dfa78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa787 expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.824852:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc08200/0xd8041b54d6dfa78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa787 expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.824860:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08200, rc 0) 00000100:00100000:1.0:1788845511.824897:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+7:14355:x1875740189601152:12345-0@lo:101:mount.lustre.0 Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845511.824904:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845511.825011:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189601152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788845511.825022:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ea00/0xd8041b54d6dfa787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa78e expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.825046:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ea00/0xd8041b54d6dfa787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa78e expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845511.825058:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788845511.825072:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ea00/0xd8041b54d6dfa787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa78e expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.825079:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ea00/0xd8041b54d6dfa787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa78e expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845511.825085:0:14355:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788845511.825089:0:14355:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788845511.825093:0:14355:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92aeadcb1000 10000000:01000000:0.0:1788845511.825095:0:14355:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788845511.825098:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788845511.825100:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788845511.825114:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e400/0xd8041b54d6dfa795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.825121:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e400/0xd8041b54d6dfa795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.825128:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e400/0xd8041b54d6dfa795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845511.825139:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189601280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788845511.825163:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.825185:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88ad0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845511.825265:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189601280 00000100:00100000:1.0:1788845511.825270:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189601280 00000100:00100000:1.0:1788845511.825421:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788845511.825429:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+7:14355:x1875740189601280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788845511.825437:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845511.825444:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc09000/0xd8041b54d6dfa79c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa795 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.825458:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc09000/0xd8041b54d6dfa79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa795 expref: 8 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.825477:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc09000/0xd8041b54d6dfa79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa795 expref: 8 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.825484:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09000, rc 0) 00000100:00100000:1.0:1788845511.825510:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+8:14355:x1875740189601280:12345-0@lo:101:mount.lustre.0 Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845511.825516:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845511.825574:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189601280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788845511.825584:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e400/0xd8041b54d6dfa795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa79c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.825592:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e400/0xd8041b54d6dfa795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa79c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845511.825641:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189601408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845511.825675:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.825885:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88ad0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845511.825915:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189601408 00000100:00100000:3.0:1788845511.825920:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189601408 00000100:00100000:3.0:1788845511.825940:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788845511.825946:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+8:14355:x1875740189601408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788845511.826327:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+9:14355:x1875740189601408:12345-0@lo:501:mount.lustre.0 Request processed in 380us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845511.826336:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845511.826504:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189601408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845511.826532:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189601536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788845511.826572:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.826600:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88ad0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845511.826654:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189601536 00000100:00100000:3.0:1788845511.826659:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189601536 00000100:00100000:3.0:1788845511.826689:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845511.826696:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+9:14355:x1875740189601536:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788845511.827097:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+9:14355:x1875740189601536:12345-0@lo:503:mount.lustre.0 Request processed in 401us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845511.827105:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788845511.827166:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189601536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788845511.828020:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14391:1875740189601664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845511.828072:0:14391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845511.828105:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea06b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788845511.828189:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189601664 00000100:00100000:2.0:1788845511.828194:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189601664 00000100:00100000:2.0:1788845511.828234:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788845511.828243:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+9:14391:x1875740189601664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845511.828571:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+9:14391:x1875740189601664:12345-0@lo:502:llog_process_th.0 Request processed in 328us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845511.828580:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845511.828996:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14391:1875740189601664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845511.829023:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845511.829034:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845511.829037:0:14391:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788845511.829044:0:14391:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788845511.829047:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788845511.829061:0:14391:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff92ae917c4d28) 00000020:00000080:0.0:1788845511.829081:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788845511.829087:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788845511.829158:0:14391:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788845511.829166:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6dfa7aa 00000020:00000080:0.0:1788845511.829424:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788845511.829435:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845511.829439:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845511.829440:0:14391:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788845511.829444:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845511.829447:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845511.829449:0:14391:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788845511.829452:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788845511.829459:0:14391:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff92ae917c19b8) 00000020:00000080:0.0:1788845511.829470:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788845511.829474:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788845511.829476:0:14391:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788845511.829479:0:14391:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788845511.829485:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788845511.829529:0:14391:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92aeadcb1000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788845511.829540:0:14391:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff92ae917c0000) 00000020:00000080:0.0:1788845511.829548:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788845511.829600:0:14391:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788845511.829607:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd8041b54d6dfa7bf 00000020:00000080:0.0:1788845511.829727:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788845511.829733:0:14391:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788845511.829738:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd8041b54d6dfa7c6 00080000:01000000:0.0:1788845511.829742:0:14391:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788845511.829745:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6dfa7cd 00010000:00010000:0.0:1788845511.888538:0:14391:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788845511.889020:0:14391:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1788845511.889293:0:14391:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788845511.890127:0:14391:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff92ae917c3370) 00000020:00000080:0.0:1788845511.890160:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788845511.890223:0:14391:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788845511.890230:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6dfa7db 00000020:00000080:3.0:1788845511.893780:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788845511.898359:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd8041b54d6dfa7e2 00000020:00000080:3.0:1788845511.899186:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788845511.899198:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845511.899209:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.899307:0:14391:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788845511.899314:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845511.899322:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.899323:0:14391:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788845511.899328:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788845511.899562:0:14391:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788845511.899603:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845511.899607:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.899609:0:14391:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788845511.899612:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788845511.899615:0:14391:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1788845511.899617:0:14391:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788845511.899619:0:14391:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788845511.899621:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788845511.899632:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.899634:0:14391:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788845511.899638:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788845511.899641:0:14391:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788845511.899645:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.899647:0:14391:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788845511.899650:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788845511.899656:0:14391:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.135@tcp to nid 0x20000c0a8ce87 (192.168.206.135@tcp) 00000020:01000000:3.0:1788845511.899687:0:14391:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788845511.899690:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788845511.899705:0:14391:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff92aebc7b3370) 00000020:00000080:3.0:1788845511.899723:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788845511.899728:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788845511.899807:0:14391:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788845511.899813:0:14391:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788845511.899819:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6dfa7f0 00010000:00080000:3.0:1788845511.899859:0:14391:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92ae93186800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:3.0:1788845511.903229:0:14391:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788845511.904057:0:14391:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788845511.904103:0:14391:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788845511.905084:0:14391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845511.905145:0:14391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788845511.905212:0:14391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788845511.906984:0:14395:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788845511.906994:0:14395:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788845511.908039:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788845511.908052:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788845511.908100:0:14391:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788845511.908121:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd8041b54d6dfa7f7 00000100:00080000:0.0:1788845511.908131:0:14391:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788845511.908137:0:14391:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92ae93186800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:0.0:1788845511.908170:0:14391:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aeadc87b80 x1875740189601792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788845511.908298:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189601792:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788845511.908354:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740189601792 offset 0 length 520: 4 00000100:00080000:0.0:1788845511.908757:0:14391:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788845511.908832:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845511.908837:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845511.908839:0:14391:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788845511.908843:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788845511.908845:0:14391:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788845511.908847:0:14391:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788845511.908849:0:14391:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788845511.908850:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788845511.908852:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845511.908854:0:14391:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788845511.908857:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788845511.908861:0:14391:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788845511.908864:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845511.908865:0:14391:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788845511.908868:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788845511.908872:0:14391:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.135@tcp to nid 0x20000c0a8ce87 (192.168.206.135@tcp) 00000020:01000000:0.0:1788845511.908898:0:14391:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788845511.908905:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788845511.908930:0:14391:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff92aebd983370) 00000020:00000080:0.0:1788845511.908944:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788845511.908950:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788845511.909027:0:14391:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788845511.909033:0:14391:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788845511.909039:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd8041b54d6dfa805 00010000:00080000:0.0:1788845511.909067:0:14391:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92aeb95b0800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:0.0:1788845511.909410:0:14391:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788845511.909702:0:14391:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788845511.909725:0:14391:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788845511.910184:0:14391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845511.910333:0:14391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788845511.910496:0:14391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788845511.911416:0:14397:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788845511.911421:0:14397:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788845511.912225:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788845511.912237:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788845511.912272:0:14391:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788845511.912290:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd8041b54d6dfa80c 00000100:00080000:3.0:1788845511.912299:0:14391:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788845511.912306:0:14391:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92aeb95b0800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1788845511.912336:0:14391:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aebc683b80 x1875740189601920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788845511.912416:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189601920:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788845511.912550:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740189601920 offset 0 length 520: 4 00000100:00080000:3.0:1788845511.912646:0:14391:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788845511.912705:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845511.912709:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.912711:0:14391:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788845511.912715:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845511.912718:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.912720:0:14391:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788845511.912723:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788845511.912725:0:14391:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788845511.912727:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845511.912729:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.912731:0:14391:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788845511.912733:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845511.912742:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.912743:0:14391:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788845511.912747:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788845511.912778:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14391:1875740189602048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845511.912829:0:14391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845511.912844:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae867d60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845511.912953:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189602048 00000100:00100000:1.0:1788845511.912959:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189602048 00000100:00100000:1.0:1788845511.912999:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788845511.913008:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+9:14391:x1875740189602048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845511.913255:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+9:14391:x1875740189602048:12345-0@lo:502:llog_process_th.0 Request processed in 248us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845511.913262:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845511.913451:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14391:1875740189602048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845511.913477:0:14391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845511.913482:0:14391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.913483:0:14391:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788845511.913487:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788845511.913646:0:14355:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788845511.913665:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788845511.913687:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e400/0xd8041b54d6dfa795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa79c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.913709:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e400/0xd8041b54d6dfa795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa79c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845511.913717:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92aeadcb1000 from 1 10000000:01000000:2.0:1788845511.913720:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788845511.913744:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.913752:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.913762:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845511.913776:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189602176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788845511.913807:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845511.913839:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae83fa9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845511.913998:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189602176 00000100:00100000:1.0:1788845511.914003:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189602176 00000100:00100000:1.0:1788845511.914037:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845511.914045:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+9:14355:x1875740189602176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788845511.914054:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845511.914067:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa81a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa813 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.914087:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa813 expref: 10 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.914103:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa813 expref: 10 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.914124:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09e00, rc 0) 00000100:00100000:1.0:1788845511.914163:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+10:14355:x1875740189602176:12345-0@lo:101:mount.lustre.0 Request processed in 118us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845511.914170:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845511.914188:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189602176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788845511.914203:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.914213:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845511.916163:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189602304:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788845511.916229:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.916274:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845511.916894:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189602304 00000100:00100000:1.0:1788845511.916902:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189602304 00000100:00100000:1.0:1788845511.916954:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845511.916964:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+10:14355:x1875740189602304:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788845511.916982:0:14366:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788845511.917073:0:14366:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788845511.917164:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+10:14355:x1875740189602304:12345-0@lo:256:mount.lustre.0 Request processed in 202us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845511.917178:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788845511.917282:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189602304:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788845511.918224:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788845511.918244:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.918253:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845511.918259:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92aeadcb1000 from 1 10000000:01000000:0.0:1788845511.918309:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845511.918335:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.918341:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.918348:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845511.918382:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189602432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788845511.918436:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.918471:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845511.918524:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189602432 00000100:00100000:2.0:1788845511.918531:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189602432 00000100:00100000:2.0:1788845511.918583:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788845511.918600:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+10:14355:x1875740189602432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788845511.918619:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845511.918645:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb7fd1c00/0xd8041b54d6dfa828 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa821 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.918666:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb7fd1c00/0xd8041b54d6dfa828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa821 expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.918688:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb7fd1c00/0xd8041b54d6dfa828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa821 expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.918695:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1c00, rc 0) 00000100:00100000:2.0:1788845511.918734:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+11:14355:x1875740189602432:12345-0@lo:101:mount.lustre.0 Request processed in 143us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845511.918741:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845511.918770:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189602432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788845511.918783:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.918792:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845511.918842:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189602560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845511.918867:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.918892:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845511.918946:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189602560 00000100:00100000:1.0:1788845511.918950:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189602560 00000100:00100000:1.0:1788845511.918973:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788845511.918978:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+11:14355:x1875740189602560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845511.919658:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189602560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788845511.919659:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+11:14355:x1875740189602560:12345-0@lo:501:mount.lustre.0 Request processed in 676us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845511.919671:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845511.919695:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189602688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788845511.919739:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.919764:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788845511.920497:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189602688 00000100:00100000:3.0:1788845511.920505:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189602688 00000100:00100000:3.0:1788845511.920541:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788845511.920549:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+11:14355:x1875740189602688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788845511.920763:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+11:14355:x1875740189602688:12345-0@lo:503:mount.lustre.0 Request processed in 205us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845511.920772:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788845511.920793:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189602688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788845511.921716:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14399:1875740189602816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845511.921850:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845511.921889:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea06b9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845511.922265:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189602816 00000100:00100000:1.0:1788845511.922272:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189602816 00000100:00100000:1.0:1788845511.922317:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788845511.922326:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+11:14399:x1875740189602816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845511.923337:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+11:14399:x1875740189602816:12345-0@lo:502:llog_process_th.0 Request processed in 1007us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845511.923357:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845511.925357:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14399:1875740189602816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845511.925435:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845511.925448:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.925451:0:14399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788845511.925458:0:14399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92aeadcb1000 00000020:00000080:3.0:1788845511.925461:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788845511.925469:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845511.925482:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.925484:0:14399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788845511.925487:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845511.925490:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.925491:0:14399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788845511.925495:0:14399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92aeadcb1000 00000020:00000080:3.0:1788845511.925497:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788845511.925641:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845511.925645:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.925647:0:14399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788845511.925649:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845511.925652:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.925653:0:14399:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788845511.925657:0:14399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92aeadcb1000 00000020:00000080:3.0:1788845511.925658:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788845511.925712:0:14399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14399:1875740189602944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845511.925789:0:14399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845511.925850:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189602944 00000100:00100000:1.0:1788845511.925863:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189602944 00000100:00100000:1.0:1788845511.925920:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788845511.925930:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+11:14399:x1875740189602944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845511.926189:0:14399:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae867d60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845511.926964:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+11:14399:x1875740189602944:12345-0@lo:502:llog_process_th.0 Request processed in 1032us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845511.926975:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788845511.927055:0:14399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14399:1875740189602944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845511.927086:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845511.927094:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845511.927097:0:14399:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788845511.927101:0:14399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788845511.927207:0:14355:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788845511.927292:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845511.927359:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.927388:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845511.927457:0:14355:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788845511.927461:0:14355:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92aeadcb1000 10000000:01000000:0.0:1788845511.927463:0:14355:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92aeadcb1000 10000000:01000000:0.0:1788845511.927468:0:14355:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788845511.927474:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92aeadcb1000 from 1 10000000:01000000:0.0:1788845511.927478:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788845511.927505:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6dfa82f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.927514:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6dfa82f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.927523:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6dfa82f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845511.927540:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189603072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788845511.927595:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.927646:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88afb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788845511.927700:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189603072 00000100:00100000:3.0:1788845511.927706:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189603072 00000100:00100000:3.0:1788845511.927747:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788845511.927756:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+11:14355:x1875740189603072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788845511.927767:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845511.927780:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6dfa836 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa82f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845511.927819:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6dfa836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa82f expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845511.927830:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb748aa00/0xd8041b54d6dfa836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa82f expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845511.927840:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb748aa00, rc 0) 00000100:00100000:3.0:1788845511.927875:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:14355:x1875740189603072:12345-0@lo:101:mount.lustre.0 Request processed in 121us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845511.927882:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788845511.927898:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189603072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788845511.927913:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6dfa82f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa836 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.927934:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6dfa82f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa836 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845511.927981:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189603200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845511.928010:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.928031:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88afb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845511.928394:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189603200 00000100:00100000:1.0:1788845511.928399:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189603200 00000100:00100000:1.0:1788845511.928423:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788845511.928430:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+12:14355:x1875740189603200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788845511.928989:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+12:14355:x1875740189603200:12345-0@lo:501:mount.lustre.0 Request processed in 557us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845511.928996:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788845511.929397:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189603200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845511.929436:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189603328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788845511.929498:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845511.929530:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189603328 00000100:00100000:3.0:1788845511.929537:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189603328 00000100:00100000:0.0:1788845511.929537:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88afb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788845511.929586:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788845511.929596:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:14355:x1875740189603328:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788845511.929978:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:14355:x1875740189603328:12345-0@lo:503:mount.lustre.0 Request processed in 383us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845511.929985:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788845511.930196:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189603328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788845511.930782:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14402:1875740189603456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845511.930832:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.930872:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88afbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788845511.930919:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189603456 00000100:00100000:2.0:1788845511.930925:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189603456 00000100:00100000:2.0:1788845511.930968:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788845511.930977:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+12:14402:x1875740189603456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845511.931198:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+12:14402:x1875740189603456:12345-0@lo:502:llog_process_th.0 Request processed in 222us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845511.931206:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788845511.931323:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14402:1875740189603456:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788845511.931544:0:14402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788845511.931559:0:14402:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff92aebd980000) 00000020:00000080:0.0:1788845511.931582:0:14402:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788845511.931824:0:14402:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92aeadcb1000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788845511.931828:0:14402:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92aeadcb1000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788845511.931830:0:14402:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92aeadcb1000 4 00010000:00080000:0.0:1788845511.931908:0:14402:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92ae8fcaf800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:0.0:1788845511.934200:0:14402:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788845511.934447:0:14402:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788845511.934501:0:14402:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788845511.934517:0:14402:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd8041b54d6dfa844 00000100:00080000:0.0:1788845511.934527:0:14402:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788845511.934533:0:14402:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff92ae8fcaf800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:0.0:1788845511.934569:0:14402:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aeadc86300 x1875740189603584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788845511.934606:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875740189603584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788845511.935234:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788845511.935297:0:14402:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788845511.936482:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189603584 00000100:00100000:1.0:1788845511.936493:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189603584 00000100:00100000:1.0:1788845511.936537:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845511.936545:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875740189603584:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788845511.936638:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875740189603584:12345-0@lo:38:llog_process_th.0 Request processed in 92us (1404us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788845511.936645:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845511.936678:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788845511.936758:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92ae8fcaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788845511.936763:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788845511.936767:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875740189603584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788845511.937201:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14402:1875740189603712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845511.937359:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.937413:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189603712 00000100:00100000:0.0:1788845511.937417:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189603712 00000100:00100000:0.0:1788845511.937451:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788845511.937471:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+12:14402:x1875740189603712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845511.938077:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+12:14402:x1875740189603712:12345-0@lo:502:llog_process_th.0 Request processed in 617us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845511.938085:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788845511.938335:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88afbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788845511.938357:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d9107f4-aa08-4701-832e-746d9df521c4:14402:1875740189603712:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788845511.938434:0:14402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788845511.938577:0:14355:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788845511.938604:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788845511.938621:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6dfa82f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa836 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.938653:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1e800/0xd8041b54d6dfa82f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa836 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788845511.938712:0:14355:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788845511.938715:0:14355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788845511.938716:0:14355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845511.938717:0:14355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845511.938719:0:14355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845511.938720:0:14355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845511.938722:0:14355:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788845511.938723:0:14355:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788845511.938725:0:14355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845511.938726:0:14355:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788845511.938731:0:14355:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788845511.938733:0:14355:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788845511.938735:0:14355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788845511.938736:0:14355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845511.938737:0:14355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845511.938738:0:14355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845511.938739:0:14355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845511.938740:0:14355:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788845511.938742:0:14355:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788845511.938743:0:14355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845511.938745:0:14355:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788845511.938762:0:14355:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788845511.938774:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189603840:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788845511.938821:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845511.938856:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc93e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845511.938906:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189603840 00000100:00100000:0.0:1788845511.938912:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189603840 00000100:00100000:0.0:1788845511.938980:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788845511.938989:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:14355:x1875740189603840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788845511.939014:0:14366:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788845511.939032:0:14366:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788845511.979114:0:14366:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788845511.979240:0:14366:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788845511.980126:0:14389:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788845511.980134:0:14389:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788845511.980159:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.980179:0:14389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa81a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa813 expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.980188:0:14389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.980232:0:14389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6dfa813 expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845511.980248:0:14389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa81a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6dfa813 expref: 12 pid: 14368 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845511.980263:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14389:1875740189603968:0@lo:104: 00000100:00100000:0.0:1788845511.980328:0:14389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845511.980415:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aea053d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845511.980863:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189603968 00000100:00100000:3.0:1788845511.980872:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189603968 00000100:00100000:3.0:1788845511.980924:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845511.980934:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d9107f4-aa08-4701-832e-746d9df521c4+3:14389:x1875740189603968:12345-0@lo:104: 00010000:00010000:3.0:1788845511.980948:0:14356:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845511.981011:0:14356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845511.981018:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d9107f4-aa08-4701-832e-746d9df521c4+3:14389:x1875740189603968:12345-0@lo:104: Request processed in 86us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845511.981042:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788845511.981448:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845511.981455:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.981476:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0000 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:1.0:1788845511.981480:0:14362:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.981489:0:14362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845511.981496:0:14362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845511.981501:0:14362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845511.981542:0:14362:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.981548:0:14362:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845511.981575:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.981582:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0000/0xd8041b54d6dfa813 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa81a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845511.981609:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845511.981612:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845511.981613:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845511.981641:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845511.981652:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d9107f4-aa08-4701-832e-746d9df521c4:3286:1875740189604096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788845511.981690:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845511.981753:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14389:1875740189603968:0@lo:104: 00000100:00100000:2.0:1788845511.981764:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189604096 00000100:00100000:2.0:1788845511.981771:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189604096 00010000:00010000:1.0:1788845511.981774:0:14389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.981797:0:14358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa81a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa813 expref: 13 pid: 14368 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845511.981834:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845511.981843:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d9107f4-aa08-4701-832e-746d9df521c4+13:3286:x1875740189604096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788845511.981854:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845511.981859:0:14358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa81a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa813 expref: 13 pid: 14368 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.981869:0:14358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6dfa813 expref: 13 pid: 14368 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.981894:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa81a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6dfa813 expref: 13 pid: 14368 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.981907:0:14358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.981915:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788845511.981929:0:14358:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001795843s 00010000:00010000:2.0:1788845511.981935:0:14358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.981942:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.981949:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.981956:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.981961:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1f000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845511.981965:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.981971:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.981994:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845511.982010:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845511.982053:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d9107f4-aa08-4701-832e-746d9df521c4+12:3286:x1875740189604096:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845511.982060:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845511.982228:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d9107f4-aa08-4701-832e-746d9df521c4:3286:1875740189604096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845511.982277:0:14389:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845511.982295:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845511.982303:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1f000/0xd8041b54d6dfa84b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845511.990930:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+11:14355:x1875740189603840:12345-0@lo:253:mount.lustre.0 Request processed in 51930us (52097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845511.990945:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788845511.991120:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:14355:1875740189603840:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788845511.991194:0:14355:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788845511.991198:0:14355:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788845511.991200:0:14355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788845511.991201:0:14355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845511.991203:0:14355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845511.991204:0:14355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845511.991205:0:14355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845511.991207:0:14355:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788845511.991208:0:14355:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788845511.991210:0:14355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845511.991211:0:14355:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788845511.991227:0:14355:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788845511.997725:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788845511.997914:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788845511.998270:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788845511.998715:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788845511.998994:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788845511.999224:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788845512.003805:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788845512.003991:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788845512.004343:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788845512.004986:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788845512.005479:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788845512.005728:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788845512.065546:0:14355:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788845512.066123:0:14355:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788845512.066400:0:14411:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788845512.066404:0:14411:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788845512.066493:0:14412:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788845512.066571:0:14412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788845512.069930:0:14355:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788845512.070065:0:14355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788845512.071682:0:14355:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788845512.071703:0:14355:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788845512.071930:0:14355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845512.072990:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788845512.073068:0:14412:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788845512.073073:0:14412:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1788845512.074006:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788845512.074892:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788845512.075007:0:14355:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788845512.076401:0:14355:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788845512.081065:0:14355:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788845512.117033:0:14355:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788845512.117076:0:14355:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf3e01d4b988 00100000:10000000:0.0:1788845512.117085:0:14355:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788845512.118852:0:14355:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788845512.118869:0:14355:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788845512.118885:0:14355:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788845512.118903:0:14355:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788845512.738674:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788845512.989270:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788845513.184635:0:14370:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788845513.184644:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92aeadcb1000 from 6 10000000:01000000:0.0:1788845513.184651:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788845513.184700:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845513.184713:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845513.184725:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845513.184771:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189604224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845513.184847:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845513.184903:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae84fb3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845513.185028:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189604224 00000100:00100000:2.0:1788845513.185036:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189604224 00000100:00100000:2.0:1788845513.185086:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788845513.185096:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+11:14370:x1875740189604224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845513.185109:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845513.185121:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb7fd1e00/0xd8041b54d6dfa859 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa852 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845513.185143:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb7fd1e00/0xd8041b54d6dfa859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa852 expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845513.185152:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb7fd1e00/0xd8041b54d6dfa859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa852 expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845513.185160:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd1e00, rc 0) 00000100:00100000:2.0:1788845513.185254:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+12:14370:x1875740189604224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845513.185269:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788845513.185533:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189604224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845513.185549:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845513.185559:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845513.185631:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189604352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788845513.185665:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845513.185733:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8318f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788845513.185770:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189604352 00000100:00100000:0.0:1788845513.185776:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189604352 00000100:00100000:0.0:1788845513.185843:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788845513.185852:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:14370:x1875740189604352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788845513.185867:0:14366:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788845513.185885:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788845513.185888:0:14366:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788845513.185971:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:14370:x1875740189604352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845513.185978:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788845513.186043:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189604352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788845513.186088:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788845513.186095:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845513.186102:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845513.755559:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788845514.013186:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788845514.779593:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845515.302728:0:14654:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788845515.804945:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845516.829506:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788845517.403517:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788845517.403524:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788845517.403526:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788845517.403528:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788845517.403531:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788845517.403534:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788845517.403537:0:38:0:(import.c:65:import_set_state_nolock()) ffff92ae8fcaf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788845517.403549:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff92ae8fcaf800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:1.0:1788845517.403569:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aebc76dc00 x1875740189604608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788845517.403695:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875740189604608:0@lo:38:kworker.0 00000100:00100000:1.0:1788845517.403758:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d9107f4-aa08-4701-832e-746d9df521c4:3286:1875740189604480:0@lo:400:kworker.0 00000100:00100000:0.0:1788845517.403763:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845517.403805:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845517.403832:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189604608 00000100:00100000:0.0:1788845517.403838:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189604608 00000100:00100000:0.0:1788845517.403879:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845517.403886:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875740189604608:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788845517.403911:0:14375:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:0.0:1788845517.403948:0:14375:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd8041b54d6dfa860 00000004:00100000:0.0:1788845517.403962:0:14375:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788845517.404115:0:14375:0:(import.c:65:import_set_state_nolock()) ffff92ae973db000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845517.404161:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875740189604608:12345-0@lo:38:kworker.0 Request processed in 274us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845517.404168:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845517.404193:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189604480 00000100:00100000:0.0:1788845517.404196:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189604480 00000100:00100000:0.0:1788845517.404281:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845517.404288:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+12:3286:x1875740189604480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845517.404325:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+12:3286:x1875740189604480:12345-0@lo:400:kworker.0 Request processed in 37us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845517.404331:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845517.404394:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d9107f4-aa08-4701-832e-746d9df521c4:3286:1875740189604480:0@lo:400:kworker.0 00010000:00080000:0.0:1788845517.404424:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92aebc76dc00 x1875740189604608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788845517.404438:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788845517.404444:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788845517.404448:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788845517.404450:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92ae8fcaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788845517.404455:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875740189604608:0@lo:38:kworker.0 00000020:00000080:1.0:1788845517.612252:0:14805:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcae675180 20000000:00000080:1.0:1788845517.612274:0:14805:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92aeb5100000 uarg=0000000000000000 20000000:01000000:1.0:1788845517.612788:0:14805:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788845517.612797:0:14805:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788845517.612803:0:14805:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788845517.615188:0:14806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788845517.615483:0:14805:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788845517.627875:0:14805:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788845517.627911:0:14805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845517.628209:0:14805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aeb7fd1c00/0xd8041b54d6dfa828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa821 expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845517.628218:0:14805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845517.628275:0:14805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aeb7fd1c00/0xd8041b54d6dfa828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6dfa821 expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845517.628292:0:14805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92aeb7fd1c00/0xd8041b54d6dfa828 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6dfa821 expref: 11 pid: 14367 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845517.628308:0:14805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14805:1875740189604736:0@lo:104: 00000100:00100000:1.0:1788845517.628417:0:14805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845517.628479:0:14805:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae88afb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788845517.630125:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189604736 00000100:00100000:3.0:1788845517.630138:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189604736 00000100:00100000:3.0:1788845517.630215:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845517.630225:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d9107f4-aa08-4701-832e-746d9df521c4+3:14805:x1875740189604736:12345-0@lo:104: 00010000:00010000:3.0:1788845517.630241:0:14356:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845517.630337:0:14356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845517.630344:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d9107f4-aa08-4701-832e-746d9df521c4+3:14805:x1875740189604736:12345-0@lo:104: Request processed in 121us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845517.630351:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788845517.630450:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845517.630457:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630466:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1ec00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:0.0:1788845517.630470:0:14362:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630500:0:14362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845517.630508:0:14362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845517.630515:0:14362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845517.630559:0:14362:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630566:0:14362:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845517.630590:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630608:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1ec00/0xd8041b54d6dfa821 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa828 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630625:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845517.630627:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845517.630628:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845517.630663:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d9107f4-aa08-4701-832e-746d9df521c4:3283:1875740189604864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845517.630702:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845517.630784:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189604864 00000100:00100000:0.0:1788845517.630788:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189604864 00010000:00010000:0.0:1788845517.630807:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aeb7fd1c00/0xd8041b54d6dfa828 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa821 expref: 12 pid: 14367 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845517.630827:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845517.630834:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d9107f4-aa08-4701-832e-746d9df521c4+12:3283:x1875740189604864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845517.630865:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845517.630871:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aeb7fd1c00/0xd8041b54d6dfa828 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa821 expref: 12 pid: 14367 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630882:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aeb7fd1c00/0xd8041b54d6dfa828 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6dfa821 expref: 12 pid: 14367 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630899:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630907:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845517.630918:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb7fd1c00/0xd8041b54d6dfa828 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6dfa821 expref: 12 pid: 14367 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630920:0:14360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630928:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845517.630930:0:14805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14805:1875740189604736:0@lo:104: 00010000:00010000:0.0:1788845517.630935:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630942:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630947:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08c00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845517.630951:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845517.630956:0:14805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630957:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845517.630965:0:14805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845517.630972:0:14805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630975:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630982:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfa867 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845517.630994:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845517.631025:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d9107f4-aa08-4701-832e-746d9df521c4+11:3283:x1875740189604864:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845517.631031:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845517.631055:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d9107f4-aa08-4701-832e-746d9df521c4:3283:1875740189604864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845517.853027:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845518.875762:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788845519.259450:0:14370:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788845519.259460:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92aeadcb1000 from 10 10000000:01000000:3.0:1788845519.259467:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788845519.259544:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845519.259555:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845519.259566:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845519.259601:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189604992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788845519.259673:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845519.259724:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae91b8be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845519.259859:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189604992 00000100:00100000:1.0:1788845519.259868:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189604992 00000100:00100000:1.0:1788845519.260047:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788845519.260060:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+11:14370:x1875740189604992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845519.260075:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845519.260090:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfa875 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa86e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845519.260114:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfa875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa86e expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845519.260125:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfa875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa86e expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845519.260134:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09600, rc 0) 00000100:00100000:1.0:1788845519.260192:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:14370:x1875740189604992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845519.260199:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788845519.260272:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189604992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845519.260287:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845519.260297:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845519.260387:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189605120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845519.260422:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845519.260565:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845519.260599:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189605120 00000100:00100000:3.0:1788845519.260604:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189605120 00000100:00100000:3.0:1788845519.260635:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788845519.260643:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+12:14370:x1875740189605120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845519.261245:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+12:14370:x1875740189605120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 600us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845519.261253:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845519.261323:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189605120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845519.261571:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189605248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845519.261697:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845519.261776:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788845519.261965:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189605248 00000100:00100000:1.0:1788845519.261972:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189605248 00000100:00100000:1.0:1788845519.262015:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788845519.262031:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:14370:x1875740189605248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845519.262265:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:14370:x1875740189605248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845519.262273:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788845519.262525:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189605248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788845519.263623:0:14892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788845519.263795:0:14370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788845519.263817:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845519.263827:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845519.263837:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845519.901026:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845520.923873:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845521.499534:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788845511/real 1788845511] req@ffff92aebc683b80 x1875740189601920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788845521 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845521.499582:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92aebc683b80 x1875740189601920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788845521 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845521.499594:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788845511/real 1788845511] req@ffff92aeadc87b80 x1875740189601792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788845521 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845521.499608:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92aeadc87b80 x1875740189601792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788845521 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788845521.499630:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92aeb95b0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788845521.499651:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788845521.499655:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189601920:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788845521.499661:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92ae93186800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788845521.499665:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788845521.499668:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189601792:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788845521.499733:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788845521.499739:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788845521.499742:0:38:0:(import.c:65:import_set_state_nolock()) ffff92ae93186800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788845521.499748:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 321 00000100:00080000:2.0:1788845521.499753:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1788845521.499753:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d9107f4-aa08-4701-832e-746d9df521c4:3284:1875740189605376:0@lo:400:kworker.0 00000100:00080000:2.0:1788845521.499764:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92ae93186800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:2.0:1788845521.499788:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ad82f4c000 x1875740189605504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788845521.499805:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788845521.499808:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788845521.499809:0:38:0:(import.c:65:import_set_state_nolock()) ffff92aeb95b0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788845521.499813:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 321 00000100:00080000:2.0:1788845521.499815:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788845521.499820:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92aeb95b0800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:0.0:1788845521.499827:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845521.499834:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ad82f4ea00 x1875740189605632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788845521.499886:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189605504:0@lo:8:kworker.0 00000100:00100000:0.0:1788845521.499903:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189605376 00000100:00100000:0.0:1788845521.499911:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189605376 00000400:00000100:2.0:1788845521.499921:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740189605504 offset 0 length 520: 4 00000100:00100000:2.0:1788845521.499941:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189605632:0@lo:8:kworker.0 00000100:00100000:0.0:1788845521.499960:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788845521.499971:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+12:3284:x1875740189605376:12345-0@lo:400:kworker.0 00000400:00000100:2.0:1788845521.499992:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740189605632 offset 0 length 520: 4 00000100:00100000:0.0:1788845521.500031:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+12:3284:x1875740189605376:12345-0@lo:400:kworker.0 Request processed in 61us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.500039:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788845521.500059:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189605760:0@lo:400:kworker.0 00000100:00100000:0.0:1788845521.500106:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d9107f4-aa08-4701-832e-746d9df521c4:3284:1875740189605376:0@lo:400:kworker.0 00000100:00100000:2.0:1788845521.500116:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845521.500156:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189605760 00000100:00100000:2.0:1788845521.500160:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189605760 00000100:00100000:2.0:1788845521.500280:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845521.500290:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189605760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845521.500334:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189605760:12345-0@lo:400:kworker.0 Request processed in 46us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845521.500341:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788845521.500395:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92ad82f4e680 x1875740189605760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845521.500406:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189605760:0@lo:400:kworker.0 00000020:01000004:1.0:1788845521.641868:0:15053:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788845521.641873:0:15053:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788845521.642014:0:15053:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92aeae520000 00000020:01000004:1.0:1788845521.642033:0:15053:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788845521.642115:0:15053:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788845521.642131:0:15053:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff92aeb7720000) 00000020:00000080:1.0:1788845521.642155:0:15053:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788845521.658866:0:15053:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788845521.659205:0:15053:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788845521.660043:0:15053:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788845521.660454:0:15053:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788845521.660681:0:15053:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788845521.661173:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 211: rc = 0 00100000:10000000:0.0:1788845521.661276:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 211: rc = 0 00100000:10000000:0.0:1788845521.661472:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 211: rc = 0 00100000:10000000:0.0:1788845521.661976:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 465: rc = 0 00100000:10000000:0.0:1788845521.662318:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 465: rc = 0 00100000:10000000:0.0:1788845521.662668:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 465: rc = 0 00100000:10000000:0.0:1788845521.662895:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 465: rc = 0 00100000:10000000:0.0:1788845521.663207:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 465: rc = 0 00100000:10000000:0.0:1788845521.663557:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 465: rc = 0 00000020:00000080:0.0:1788845521.664203:0:15053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788845521.664215:0:15053:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788845521.664227:0:15053:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd8041b54d6dfa883 00000020:01000004:0.0:1788845521.664235:0:15053:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788845521.664257:0:15053:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.135@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788845521.664261:0:15053:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788845521.664267:0:15053:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788845521.664271:0:15053:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788845521.664283:0:15053:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff92aebd984d28) 00000020:00000080:0.0:1788845521.664293:0:15053:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788845521.665529:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845521.665832:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788845521.665838:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788845521.666618:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788845521.666625:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788845521.666846:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788845521.666851:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788845521.678758:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845521.679010:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788845521.679016:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788845521.679825:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788845521.679832:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788845521.709969:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788845521.710798:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788845521.710805:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788845521.713914:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788845521.713933:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788845521.715239:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788845521.715252:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788845521.721014:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788845521.721618:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788845521.721625:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788845521.722255:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788845521.722263:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788845521.765626:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788845521.765849:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788845521.765856:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788845521.767691:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788845521.767704:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788845521.768133:0:15053:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788845521.768159:0:15053:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788845521.768167:0:15053:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788845521.779141:0:15053:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788845521.779185:0:15053:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.135@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788845521.779190:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788845521.779196:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788845521.779197:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845521.779199:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845521.779199:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845521.779201:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845521.779202:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845521.779203:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845521.779205:0:15053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788845521.779208:0:15053:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788845521.779210:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788845521.779211:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788845521.779212:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845521.779213:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845521.779214:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845521.779215:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845521.779216:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845521.779217:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845521.779218:0:15053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788845521.779243:0:15053:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788845521.779264:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189605888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788845521.779351:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.779650:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950540 going to sleep for 11 seconds 00000100:00100000:1.0:1788845521.779724:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189605888 00000100:00100000:1.0:1788845521.779732:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189605888 00000100:00100000:1.0:1788845521.779897:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788845521.779907:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:15053:x1875740189605888:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788845521.779941:0:14366:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788845521.779945:0:14366:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788845521.779950:0:14366:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788845521.796722:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:15053:x1875740189605888:12345-0@lo:253:mount.lustre.0 Request processed in 16807us (17361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845521.796737:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788845521.796784:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189605888:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788845521.796808:0:15053:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788845521.796812:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788845521.796814:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788845521.796816:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845521.796817:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845521.796818:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845521.796820:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845521.796821:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845521.796823:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845521.796825:0:15053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788845521.796854:0:15053:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92aeae520000 from lustre-OST0000 10000000:01000000:3.0:1788845521.796887:0:15053:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788845521.796890:0:15053:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788845521.796898:0:15053:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92aeb7723370 local copy 00010000:00010000:3.0:1788845521.796921:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa780 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845521.797175:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788845521.797239:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.797288:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950300 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.797431:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189606016 00000100:00100000:0.0:1788845521.797441:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189606016 00000100:00100000:0.0:1788845521.797493:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788845521.797504:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+12:15053:x1875740189606016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845521.797830:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+12:15053:x1875740189606016:12345-0@lo:501:mount.lustre.0 Request processed in 327us (589us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788845521.797850:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788845521.797868:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606016:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788845521.797890:0:15053:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788845521.798077:0:15053:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788845521.798086:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa780 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.798097:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa780 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845521.798122:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92aeae520000 10000000:01000000:3.0:1788845521.798127:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788845521.798132:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff92aeb7723370 10000000:01000000:3.0:1788845521.798135:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788845521.798139:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff92aeb7723370 from 1 10000000:01000000:3.0:1788845521.798142:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788845521.798173:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748a000/0xd8041b54d6dfa891 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.798182:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb748a000/0xd8041b54d6dfa891 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.798192:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb748a000/0xd8041b54d6dfa891 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845521.798219:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788845521.798260:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.798294:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950300 going to sleep for 11 seconds 00000100:00100000:1.0:1788845521.798425:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189606144 00000100:00100000:1.0:1788845521.798433:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189606144 00000100:00100000:1.0:1788845521.798516:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788845521.798525:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+12:15053:x1875740189606144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788845521.798549:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845521.798587:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc09800/0xd8041b54d6dfa898 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa891 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.798984:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc09800/0xd8041b54d6dfa898 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa891 expref: 13 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.798997:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc09800/0xd8041b54d6dfa898 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa891 expref: 13 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.799006:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09800, rc 0) 00000100:00100000:0.0:1788845521.799094:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+13:15053:x1875740189606144:12345-0@lo:101:mount.lustre.0 Request processed in 570us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.799103:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788845521.799114:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788845521.799141:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb748a000/0xd8041b54d6dfa891 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa898 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.799155:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb748a000/0xd8041b54d6dfa891 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa898 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845521.799180:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788845521.799196:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748a000/0xd8041b54d6dfa891 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa898 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.799204:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb748a000/0xd8041b54d6dfa891 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa898 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845521.799211:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788845521.799216:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845521.799221:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788845521.799223:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788845521.799246:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6dfa89f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.799255:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6dfa89f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.799263:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6dfa89f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845521.799290:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788845521.799331:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.799394:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950300 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.799478:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189606272 00000100:00100000:0.0:1788845521.799500:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189606272 00000100:00100000:0.0:1788845521.799605:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788845521.799617:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+13:15053:x1875740189606272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788845521.799641:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845521.799653:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1e000/0xd8041b54d6dfa8a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa89f expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.799684:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1e000/0xd8041b54d6dfa8a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa89f expref: 14 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.799720:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1e000/0xd8041b54d6dfa8a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa89f expref: 14 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.799746:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1e000, rc 0) 00000100:00100000:0.0:1788845521.799847:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+14:15053:x1875740189606272:12345-0@lo:101:mount.lustre.0 Request processed in 221us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845521.799856:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788845521.799857:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1788845521.799876:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6dfa89f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8a6 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.799888:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6dfa89f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa8a6 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788845521.800566:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788845521.801509:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845521.801818:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788845521.801865:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788845521.801900:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788845521.801950:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788845521.801991:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788845521.802027:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788845521.802097:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788845521.802106:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788845521.802188:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788845521.802258:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.802306:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.802450:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189606400 00000100:00100000:0.0:1788845521.802463:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189606400 00000100:00100000:3.0:1788845521.802717:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788845521.802733:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+14:15053:x1875740189606400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788845521.803112:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+14:15053:x1875740189606400:12345-0@lo:501:mount.lustre.0 Request processed in 384us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845521.803126:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788845521.803215:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788845521.803329:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788845521.803506:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845521.803584:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f71900 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.803693:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189606528 00000100:00100000:0.0:1788845521.803698:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189606528 00000100:00100000:0.0:1788845521.803768:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788845521.803778:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+14:15053:x1875740189606528:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788845521.804262:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+14:15053:x1875740189606528:12345-0@lo:503:mount.lustre.0 Request processed in 485us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.804270:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788845521.804478:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606528:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788845521.805220:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788845521.805294:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788845521.805353:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.805418:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.805444:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189606656 00000100:00100000:0.0:1788845521.805454:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189606656 00000100:00100000:0.0:1788845521.805549:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788845521.805558:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+14:15053:x1875740189606656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788845521.805808:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+14:15053:x1875740189606656:12345-0@lo:502:mount.lustre.0 Request processed in 251us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.805817:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845521.805853:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788845521.806077:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788845521.806129:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788845521.806155:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788845521.806192:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788845521.806220:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788845521.806245:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788845521.806280:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788845521.806307:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788845521.806331:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788845521.806413:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788845521.806445:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788845521.806496:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788845521.806524:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788845521.806583:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845521.809564:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189606784 00000100:00100000:2.0:1788845521.809589:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189606784 00000100:00100000:2.0:1788845521.809668:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788845521.809672:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845521.809714:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+14:15053:x1875740189606784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788845521.810606:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+14:15053:x1875740189606784:12345-0@lo:502:mount.lustre.0 Request processed in 921us (4025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845521.810618:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788845521.810630:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788845521.810807:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788845521.810824:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788845521.811847:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788845521.811868:0:15067:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788845521.811877:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845521.811879:0:15067:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788845521.811886:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788845521.811902:0:15067:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff92aebc7b0000) 00000020:00000080:3.0:1788845521.811927:0:15067:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788845521.811934:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788845521.812012:0:15067:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92aeae520000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788845521.812019:0:15067:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788845521.812026:0:15067:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd8041b54d6dfa8b4 00010000:00010000:3.0:1788845521.817173:0:15067:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788845521.819652:0:15067:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788845521.822636:0:15067:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788845521.825236:0:15067:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788845521.825251:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845521.825259:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.825261:0:15067:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788845521.825267:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788845521.825270:0:15067:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788845521.825277:0:15067:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788845521.825280:0:15067:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788845521.825282:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788845521.825285:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.825286:0:15067:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788845521.825289:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845521.825297:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.825299:0:15067:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788845521.825302:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788845521.825304:0:15067:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788845521.825306:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845521.825309:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.825310:0:15067:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788845521.825313:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845521.825314:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.825315:0:15067:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788845521.825318:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788845521.825423:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845521.825427:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.825429:0:15067:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788845521.825432:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788845521.825612:0:15053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788845521.825661:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788845521.825689:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6dfa89f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8a6 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.825704:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb748a400/0xd8041b54d6dfa89f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8a6 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845521.825714:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92aeae520000 from 1 10000000:01000000:1.0:1788845521.825717:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845521.825778:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.825797:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.825811:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845521.825841:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788845521.825932:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845521.825988:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845521.826854:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189606912 00000100:00100000:2.0:1788845521.826868:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189606912 00000100:00100000:2.0:1788845521.826932:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788845521.826952:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+14:15053:x1875740189606912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788845521.826969:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845521.827008:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeb7fd0000/0xd8041b54d6dfa8c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa8bb expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845521.827040:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeb7fd0000/0xd8041b54d6dfa8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa8bb expref: 15 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845521.827065:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeb7fd0000/0xd8041b54d6dfa8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa8bb expref: 15 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845521.827074:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeb7fd0000, rc 0) 00000100:00100000:2.0:1788845521.827154:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+15:15053:x1875740189606912:12345-0@lo:101:mount.lustre.0 Request processed in 213us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845521.827162:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788845521.827210:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189606912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788845521.827235:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.827245:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788845521.831144:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788845521.832615:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788845521.833159:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788845521.833210:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788845521.833293:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788845521.833305:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788845521.833420:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788845521.833501:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845521.833554:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.833952:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189607040 00000100:00100000:0.0:1788845521.833960:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189607040 00000100:00100000:0.0:1788845521.834011:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788845521.834020:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+15:15053:x1875740189607040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845521.834271:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+15:15053:x1875740189607040:12345-0@lo:501:mount.lustre.0 Request processed in 251us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.834278:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788845521.834454:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788845521.834496:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788845521.834541:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.834587:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ea0b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.834807:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189607168 00000100:00100000:0.0:1788845521.834812:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189607168 00000100:00100000:0.0:1788845521.834837:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788845521.834844:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+15:15053:x1875740189607168:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788845521.835119:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+15:15053:x1875740189607168:12345-0@lo:503:mount.lustre.0 Request processed in 274us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.835126:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788845521.835331:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607168:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788845521.836489:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788845521.836659:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788845521.836855:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.836996:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ea0b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.837043:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189607296 00000100:00100000:0.0:1788845521.837049:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189607296 00000100:00100000:0.0:1788845521.837097:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788845521.837105:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+15:15053:x1875740189607296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788845521.839602:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+15:15053:x1875740189607296:12345-0@lo:502:mount.lustre.0 Request processed in 2485us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.839617:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845521.842149:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788845521.842522:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788845521.842594:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788845521.842647:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788845521.842683:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788845521.842717:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788845521.843040:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788845521.843084:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788845521.843117:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788845521.843501:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788845521.843603:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.843651:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ea0b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845521.843713:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189607424 00000100:00100000:1.0:1788845521.843721:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189607424 00000100:00100000:1.0:1788845521.843788:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788845521.843799:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+15:15053:x1875740189607424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788845521.844059:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+15:15053:x1875740189607424:12345-0@lo:502:mount.lustre.0 Request processed in 262us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845521.844067:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788845521.844143:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788845521.844563:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788845521.844592:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788845521.847422:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845521.847438:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.847441:0:15071:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788845521.847451:0:15071:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92aeae520000 00000020:00000080:0.0:1788845521.847454:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788845521.847462:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845521.847465:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.847466:0:15071:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788845521.847469:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845521.847471:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.847473:0:15071:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788845521.847476:0:15071:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92aeae520000 00000020:00000080:0.0:1788845521.847478:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788845521.847540:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845521.847543:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.847544:0:15071:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788845521.847547:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845521.847550:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.847551:0:15071:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788845521.847555:0:15071:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92aeae520000 00000020:00000080:0.0:1788845521.847567:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788845521.847619:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845521.847623:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845521.847624:0:15071:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788845521.847628:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788845521.848027:0:15053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788845521.848059:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845521.848078:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.848090:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845521.848137:0:15053:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788845521.848139:0:15053:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92aeae520000 10000000:01000000:3.0:1788845521.848143:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92aeae520000 10000000:01000000:3.0:1788845521.848147:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845521.848153:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92aeae520000 from 1 10000000:01000000:3.0:1788845521.848156:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788845521.848190:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748ae00/0xd8041b54d6dfa8c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.848198:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb748ae00/0xd8041b54d6dfa8c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.848209:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb748ae00/0xd8041b54d6dfa8c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845521.848242:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788845521.848329:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.848393:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ea0b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.849214:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189607552 00000100:00100000:0.0:1788845521.849226:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189607552 00000100:00100000:0.0:1788845521.849292:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788845521.849302:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+15:15053:x1875740189607552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788845521.849607:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845521.849626:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1ec00/0xd8041b54d6dfa8d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa8c9 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.849653:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1ec00/0xd8041b54d6dfa8d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa8c9 expref: 16 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.849666:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1ec00/0xd8041b54d6dfa8d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa8c9 expref: 16 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.849675:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1ec00, rc 0) 00000100:00100000:0.0:1788845521.849744:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+16:15053:x1875740189607552:12345-0@lo:101:mount.lustre.0 Request processed in 443us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.849752:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788845521.849816:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788845521.849834:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb748ae00/0xd8041b54d6dfa8c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8d0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.849844:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb748ae00/0xd8041b54d6dfa8c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa8d0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788845521.859355:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788845521.860626:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845521.861239:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788845521.861291:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788845521.861327:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788845521.861404:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788845521.861441:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788845521.861497:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788845521.861550:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788845521.861613:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788845521.861684:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788845521.861902:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788845521.861952:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788845521.862071:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788845521.862114:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788845521.862180:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788845521.862259:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788845521.862298:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788845521.862330:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788845521.862444:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788845521.862502:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788845521.862551:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788845521.862618:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788845521.862662:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788845521.862705:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788845521.862859:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788845521.862900:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788845521.862935:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788845521.862983:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788845521.863020:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788845521.863108:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788845521.863118:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788845521.863220:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788845521.863298:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.863938:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ea0b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.864136:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189607680 00000100:00100000:0.0:1788845521.864145:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189607680 00000100:00100000:0.0:1788845521.864194:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788845521.864203:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+16:15053:x1875740189607680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845521.867493:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+16:15053:x1875740189607680:12345-0@lo:501:mount.lustre.0 Request processed in 3279us (4184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.867520:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788845521.867632:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788845521.867692:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788845521.868303:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.868349:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ea0b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.868428:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189607808 00000100:00100000:0.0:1788845521.868435:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189607808 00000100:00100000:0.0:1788845521.868480:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788845521.868490:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+16:15053:x1875740189607808:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788845521.869559:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+16:15053:x1875740189607808:12345-0@lo:503:mount.lustre.0 Request processed in 1066us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.869581:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788845521.875417:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607808:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788845521.876164:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788845521.876416:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788845521.876504:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.876545:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ea0b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.876675:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189607936 00000100:00100000:0.0:1788845521.876683:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189607936 00000100:00100000:0.0:1788845521.876741:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788845521.876752:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+16:15053:x1875740189607936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788845521.876982:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+16:15053:x1875740189607936:12345-0@lo:502:mount.lustre.0 Request processed in 232us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.876990:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788845521.878412:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189607936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788845521.878740:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788845521.878813:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788845521.878850:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788845521.878902:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788845521.878940:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788845521.878990:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788845521.879030:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788845521.879067:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788845521.879129:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788845521.879170:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788845521.879206:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788845521.881858:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788845521.881969:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788845521.882028:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788845521.882083:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788845521.882126:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788845521.882162:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788845521.882213:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788845521.882841:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788845521.883033:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788845521.883118:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788845521.883160:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788845521.883193:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788845521.884435:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788845521.884513:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788845521.884540:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788845521.884594:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788845521.884630:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788845521.884661:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788845521.884725:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788845521.884760:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788845521.884788:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788845521.884820:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788845521.884881:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788845521.884929:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788845521.884979:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788845521.885016:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788845521.885045:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788845521.885092:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788845521.885129:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788845521.885180:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189608064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788845521.885277:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.885334:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ea0b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.885669:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189608064 00000100:00100000:0.0:1788845521.885678:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189608064 00000100:00100000:0.0:1788845521.885724:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788845521.885735:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+16:15053:x1875740189608064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788845521.886038:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+16:15053:x1875740189608064:12345-0@lo:502:mount.lustre.0 Request processed in 304us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845521.886046:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788845521.890715:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189608064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788845521.890884:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788845521.890900:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788845521.895143:0:15076:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788845521.895162:0:15076:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92ae8ff08000) 00000020:00000080:2.0:1788845521.895186:0:15076:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788845521.895285:0:15076:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92aeae520000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788845521.895289:0:15076:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92aeae520000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788845521.895292:0:15076:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92aeae520000 3 00010000:00080000:2.0:1788845521.895458:0:15076:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92ae90d35800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.135@tcp at head 00010000:00010000:2.0:1788845521.898727:0:15076:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788845521.898992:0:15076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788845521.899033:0:15076:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788845521.899046:0:15076:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd8041b54d6dfa8de 00000100:00080000:2.0:1788845521.899056:0:15076:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788845521.899062:0:15076:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92ae90d35800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:2.0:1788845521.899097:0:15076:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ad82f4e680 x1875740189608192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788845521.899130:0:15076:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788845521.899232:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875740189608192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788845521.899329:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845521.899797:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189608192 00000100:00100000:2.0:1788845521.899804:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189608192 00000100:00100000:2.0:1788845521.899841:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845521.899849:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1875740189608192:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788845521.899871:0:14374:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 331 last 0 00000020:00000080:2.0:1788845521.899901:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd8041b54d6dfa8e5 00000004:00100000:2.0:1788845521.899915:0:14374:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788845521.899948:0:14374:0:(import.c:65:import_set_state_nolock()) ffff92ad813a3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845521.899997:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875740189608192:12345-0@lo:38:llog_process_th.0 Request processed in 147us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845521.900005:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788845521.900079:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788845521.900085:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788845521.900088:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788845521.900100:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788845521.900325:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189608320:0@lo:400:kworker.0 00000100:00100000:2.0:1788845521.900358:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845521.902471:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189608320 00000100:00100000:1.0:1788845521.902485:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189608320 00000100:00100000:1.0:1788845521.902539:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845521.902548:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189608320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845521.902637:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189608320:12345-0@lo:400:kworker.0 Request processed in 90us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845521.902644:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788845521.902688:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92ad82f4e680 x1875740189608192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845521.902698:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788845521.902707:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788845521.902714:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788845521.902718:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788845521.902721:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92ae90d35800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788845521.902728:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875740189608192:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788845521.902766:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92aeadc85c00 x1875740189608320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845521.902775:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189608320:0@lo:400:kworker.0 00000040:00080000:0.0:1788845521.902838:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788845521.903323:0:15053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788845521.903350:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788845521.903407:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748ae00/0xd8041b54d6dfa8c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8d0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845521.903418:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb748ae00/0xd8041b54d6dfa8c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8d0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788845521.903462:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788845521.903464:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788845521.903466:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845521.903467:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845521.903468:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845521.903470:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845521.903471:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845521.903473:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845521.903474:0:15053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788845521.903479:0:15053:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788845521.903481:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788845521.903483:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788845521.903488:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845521.903489:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845521.903489:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845521.903491:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845521.903492:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845521.903493:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845521.903494:0:15053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788845521.903513:0:15053:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788845521.903530:0:15053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189608448:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788845521.903767:0:15053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845521.903836:0:15053:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ea0b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845521.903877:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189608448 00000100:00100000:0.0:1788845521.903883:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189608448 00000100:00100000:0.0:1788845521.903917:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788845521.903924:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+16:15053:x1875740189608448:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788845521.903959:0:14368:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788845521.903976:0:14368:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788845521.929043:0:14368:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788845521.929062:0:14368:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788845521.929085:0:14389:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788845521.929089:0:14389:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788845521.929111:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.929129:0:14389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aeb7fd1e00/0xd8041b54d6dfa859 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa852 expref: 16 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.929139:0:14389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.929182:0:14389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aeb7fd1e00/0xd8041b54d6dfa859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6dfa852 expref: 16 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845521.929196:0:14389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92aeb7fd1e00/0xd8041b54d6dfa859 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6dfa852 expref: 16 pid: 14368 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845521.929213:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc87100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14389:1875740189608576:0@lo:104: 00000100:00100000:0.0:1788845521.929512:0:14389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845521.929561:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98ef9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845521.929983:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189608576 00000100:00100000:1.0:1788845521.929991:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189608576 00000100:00100000:1.0:1788845521.930046:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845521.930055:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d9107f4-aa08-4701-832e-746d9df521c4+3:14389:x1875740189608576:12345-0@lo:104: 00010000:00010000:1.0:1788845521.930068:0:14356:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.930127:0:14356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788845521.930133:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d9107f4-aa08-4701-832e-746d9df521c4+3:14389:x1875740189608576:12345-0@lo:104: Request processed in 80us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845521.930141:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788845521.930172:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845521.930179:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.930186:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1f600 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:1.0:1788845521.930191:0:14361:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.930200:0:14361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845521.930208:0:14361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845521.930214:0:14361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845521.930656:0:14361:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.930664:0:14361:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845521.930696:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.930702:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f600/0xd8041b54d6dfa852 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa859 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.930721:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845521.930723:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845521.930725:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845521.930743:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845521.930754:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d9107f4-aa08-4701-832e-746d9df521c4:3284:1875740189608704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788845521.930791:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845521.930877:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189608704 00000100:00100000:1.0:1788845521.930883:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189608704 00010000:00010000:1.0:1788845521.930903:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aeb7fd1e00/0xd8041b54d6dfa859 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa852 expref: 17 pid: 14368 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845521.930928:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845521.930935:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d9107f4-aa08-4701-832e-746d9df521c4+17:3284:x1875740189608704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788845521.930947:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845521.930951:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aeb7fd1e00/0xd8041b54d6dfa859 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa852 expref: 17 pid: 14368 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.930962:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aeb7fd1e00/0xd8041b54d6dfa859 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6dfa852 expref: 17 pid: 14368 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.930980:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.930989:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788845521.931003:0:14359:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001914831s 00010000:00010000:1.0:1788845521.931009:0:14359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.931017:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.931025:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.931032:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.931049:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1fc00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845521.931053:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.931061:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.931070:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.931079:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845521.931109:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d9107f4-aa08-4701-832e-746d9df521c4+17:3284:x1875740189608704:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845521.931117:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845521.931155:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d9107f4-aa08-4701-832e-746d9df521c4:3284:1875740189608704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788845521.931185:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb7fd1e00/0xd8041b54d6dfa859 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6dfa852 expref: 16 pid: 14368 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845521.931196:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc87100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14389:1875740189608576:0@lo:104: 00010000:00010000:1.0:1788845521.931208:0:14389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.931217:0:14389:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.931224:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845521.931253:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fd1fc00/0xd8041b54d6dfa8ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845521.941883:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+15:15053:x1875740189608448:12345-0@lo:253:mount.lustre.0 Request processed in 37947us (38104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845521.941899:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788845521.942006:0:15053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15053:1875740189608448:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788845521.942022:0:15053:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788845521.942025:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788845521.942027:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788845521.942029:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845521.942030:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845521.942031:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845521.942033:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845521.942034:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845521.942036:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845521.942037:0:15053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788845521.942051:0:15053:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788845521.947267:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788845521.947473:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788845521.947676:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788845521.947841:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788845521.947994:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788845521.948211:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00010000:0.0:1788845521.948624:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788845521.949789:0:15053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788845522.004096:0:15053:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788845522.004107:0:15053:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788845522.004146:0:15053:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788845522.004215:0:15053:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788845522.004231:0:15053:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788845522.004528:0:15053:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788845522.975444:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788845523.931829:0:14370:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788845523.931838:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92aeadcb1000 from 7 10000000:01000000:2.0:1788845523.931844:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788845523.931887:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845523.931901:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845523.931926:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845523.931953:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189608832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845523.932041:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845523.932092:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae91614900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845523.932307:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189608832 00000100:00100000:1.0:1788845523.932315:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189608832 00000100:00100000:1.0:1788845523.932393:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788845523.932403:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+15:14370:x1875740189608832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845523.932417:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845523.932431:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa8fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa8f3 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845523.932452:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa8f3 expref: 16 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845523.932462:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa8f3 expref: 16 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845523.932470:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09e00, rc 0) 00000100:00100000:1.0:1788845523.932508:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+16:14370:x1875740189608832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845523.932515:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788845523.932615:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189608832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845523.932629:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845523.932637:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845523.932686:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189608960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788845523.932716:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845523.932745:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae91614900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845523.932828:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189608960 00000100:00100000:1.0:1788845523.932833:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189608960 00000100:00100000:1.0:1788845523.932858:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788845523.932865:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+16:14370:x1875740189608960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788845523.932888:0:14368:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788845523.932906:0:14368:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788845523.932910:0:14368:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788845523.933001:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+16:14370:x1875740189608960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845523.933008:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788845523.933171:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189608960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788845523.933230:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788845523.933236:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845523.933245:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845523.996557:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788845524.252020:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788845525.020067:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845526.043864:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845527.068532:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788845527.137703:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788845527.137711:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788845527.137714:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788845527.137718:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788845527.137772:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d9107f4-aa08-4701-832e-746d9df521c4:3284:1875740189609088:0@lo:400:kworker.0 00000100:00100000:1.0:1788845527.137845:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845527.137908:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189609216:0@lo:400:kworker.0 00000100:00100000:1.0:1788845527.137937:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845527.137959:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845527.137965:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189609344:0@lo:400:kworker.0 00000100:00100000:1.0:1788845527.137986:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845527.138017:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189609088 00000100:00100000:1.0:1788845527.138024:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189609088 00000100:00100000:1.0:1788845527.138070:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788845527.138079:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+16:3284:x1875740189609088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845527.138126:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+16:3284:x1875740189609088:12345-0@lo:400:kworker.0 Request processed in 48us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845527.138145:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788845527.138181:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189609216 00000100:00100000:1.0:1788845527.138184:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189609216 00000100:00100000:1.0:1788845527.138206:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189609344 00000100:00100000:1.0:1788845527.138208:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189609344 00000100:00100000:1.0:1788845527.138232:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845527.138238:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189609216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845527.138274:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189609216:12345-0@lo:400:kworker.0 Request processed in 35us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845527.138280:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845527.138290:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845527.138296:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189609344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845527.138320:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189609344:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845527.138325:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788845527.138437:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788845527.141188:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc76ea00 x1875740189609344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845527.141210:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189609344:0@lo:400:kworker.0 00010000:00080000:1.0:1788845527.141245:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc76c000 x1875740189609216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845527.141254:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189609216:0@lo:400:kworker.0 00000100:00100000:1.0:1788845527.141313:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d9107f4-aa08-4701-832e-746d9df521c4:3284:1875740189609088:0@lo:400:kworker.0 00000001:02000400:2.0:1788845527.655734:0:15422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788845528.092296:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845529.118189:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845530.142263:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845531.163720:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845532.187966:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788845532.258564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788845532.258571:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788845532.258574:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788845532.258577:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788845532.258630:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189609600:0@lo:400:kworker.0 00000100:00100000:3.0:1788845532.258706:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845532.258778:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845532.258786:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d9107f4-aa08-4701-832e-746d9df521c4:3284:1875740189609472:0@lo:400:kworker.0 00000100:00100000:3.0:1788845532.258817:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845532.258848:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189609728:0@lo:400:kworker.0 00000100:00100000:3.0:1788845532.258895:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845532.258935:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189609600 00000100:00100000:3.0:1788845532.258943:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189609600 00000100:00100000:3.0:1788845532.258986:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189609728 00000100:00100000:3.0:1788845532.258990:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189609728 00000100:00100000:3.0:1788845532.259016:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845532.259025:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189609600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845532.259075:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875740189609600:12345-0@lo:400:kworker.0 Request processed in 51us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845532.259082:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845532.259098:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845532.259105:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189609728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845532.259135:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189609728:12345-0@lo:400:kworker.0 Request processed in 31us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845532.259141:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845532.259158:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189609472 00000100:00100000:3.0:1788845532.259161:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189609472 00000100:00100000:3.0:1788845532.259187:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788845532.259194:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+16:3284:x1875740189609472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845532.259223:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+16:3284:x1875740189609472:12345-0@lo:400:kworker.0 Request processed in 30us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845532.259229:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788845532.259258:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788845532.259285:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc681500 x1875740189609728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845532.259299:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189609728:0@lo:400:kworker.0 00000100:00100000:3.0:1788845532.259339:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d9107f4-aa08-4701-832e-746d9df521c4:3284:1875740189609472:0@lo:400:kworker.0 00010000:00080000:3.0:1788845532.259350:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc680380 x1875740189609600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845532.259359:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875740189609600:0@lo:400:kworker.0 00010000:00010000:2.0:1788845533.211620:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788845534.044402:0:15772:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788845534.044420:0:15772:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788845534.044585:0:15772:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92ae885b2800 00000020:01000004:1.0:1788845534.044603:0:15772:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788845534.044617:0:15772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788845534.044630:0:15772:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff92aeb77219b8) 00000020:00000080:1.0:1788845534.044647:0:15772:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788845534.061941:0:15772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788845534.062527:0:15772:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788845534.063287:0:15772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788845534.063754:0:15772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788845534.063963:0:15772:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788845534.064358:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 597: rc = 0 00100000:10000000:1.0:1788845534.064638:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 597: rc = 0 00100000:10000000:1.0:1788845534.064791:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 597: rc = 0 00100000:10000000:1.0:1788845534.065308:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 775: rc = 0 00100000:10000000:1.0:1788845534.065687:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 775: rc = 0 00100000:10000000:1.0:1788845534.067237:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:1.0:1788845534.067724:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:1.0:1788845534.068021:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 775: rc = 0 00100000:10000000:1.0:1788845534.068269:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 775: rc = 0 00000020:00000080:1.0:1788845534.069446:0:15772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788845534.069460:0:15772:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788845534.069472:0:15772:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd8041b54d6dfa908 00000020:01000004:1.0:1788845534.069481:0:15772:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788845534.069513:0:15772:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.135@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788845534.069517:0:15772:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788845534.069524:0:15772:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788845534.069615:0:15772:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788845534.069620:0:15772:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788845534.080643:0:15772:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788845534.080691:0:15772:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.135@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788845534.080696:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788845534.080698:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788845534.080700:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845534.080701:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845534.080702:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845534.080704:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845534.080705:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788845534.080707:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845534.080708:0:15772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788845534.080712:0:15772:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788845534.080715:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788845534.080716:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788845534.080718:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845534.080719:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845534.080720:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845534.080722:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845534.080723:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788845534.080724:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845534.080725:0:15772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788845534.080862:0:15772:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788845534.080888:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189609856:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788845534.080966:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845534.081095:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae82f03300 going to sleep for 11 seconds 00000100:00100000:2.0:1788845534.081260:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189609856 00000100:00100000:2.0:1788845534.081268:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189609856 00000100:00100000:2.0:1788845534.081412:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788845534.081425:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+16:15772:x1875740189609856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788845534.081456:0:14368:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788845534.081460:0:14368:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788845534.081465:0:14368:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788845534.087810:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+16:15772:x1875740189609856:12345-0@lo:253:mount.lustre.0 Request processed in 6380us (6833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845534.087826:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788845534.087915:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189609856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788845534.087931:0:15772:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788845534.087934:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788845534.087936:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788845534.087937:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845534.087938:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845534.087940:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845534.087941:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845534.087942:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788845534.087944:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845534.087946:0:15772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788845534.087983:0:15772:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92ae885b2800 from lustre-OST0001 10000000:01000000:1.0:1788845534.088010:0:15772:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788845534.088013:0:15772:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788845534.088021:0:15772:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92aeb7723370 local copy 00010000:00010000:1.0:1788845534.088031:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa780 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845534.088474:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189609984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788845534.088528:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845534.088673:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebc93ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845534.088719:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189609984 00000100:00100000:3.0:1788845534.088726:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189609984 00000100:00100000:3.0:1788845534.088805:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788845534.088815:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+16:15772:x1875740189609984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788845534.089006:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+16:15772:x1875740189609984:12345-0@lo:501:mount.lustre.0 Request processed in 193us (477us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845534.089014:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788845534.089090:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189609984:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788845534.089105:0:15772:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788845534.090138:0:15772:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788845534.090152:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa780 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845534.090165:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0200/0xd8041b54d6dfa779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa780 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845534.090198:0:15772:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92ae885b2800 10000000:01000000:2.0:1788845534.090206:0:15772:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788845534.090213:0:15772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788845534.090215:0:15772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788845534.090220:0:15772:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788845534.090222:0:15772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788845534.090252:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1600/0xd8041b54d6dfa90f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845534.090272:0:15772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1600/0xd8041b54d6dfa90f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845534.090296:0:15772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1600/0xd8041b54d6dfa90f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845534.090316:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788845534.090382:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845534.090743:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae82d58240 going to sleep for 11 seconds 00000100:00100000:1.0:1788845534.090839:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189610112 00000100:00100000:1.0:1788845534.090846:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189610112 00000100:00100000:1.0:1788845534.090883:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788845534.090896:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+16:15772:x1875740189610112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788845534.090907:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845534.090920:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc09200/0xd8041b54d6dfa916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa90f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.090942:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc09200/0xd8041b54d6dfa916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa90f expref: 17 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.090953:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc09200/0xd8041b54d6dfa916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa90f expref: 17 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.090961:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09200, rc 0) 00000100:00100000:1.0:1788845534.091052:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+17:15772:x1875740189610112:12345-0@lo:101:mount.lustre.0 Request processed in 160us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845534.091060:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788845534.091248:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788845534.091307:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1600/0xd8041b54d6dfa90f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa916 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845534.091318:0:15772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1600/0xd8041b54d6dfa90f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa916 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788845534.092711:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788845534.094783:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845534.095268:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788845534.095327:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788845534.095448:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788845534.095502:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788845534.095809:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788845534.095846:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788845534.095985:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788845534.095992:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788845534.096096:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788845534.096169:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845534.096261:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae931c7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788845534.096317:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189610240 00000100:00100000:1.0:1788845534.096334:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189610240 00000100:00100000:1.0:1788845534.096540:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788845534.096618:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+17:15772:x1875740189610240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788845534.097163:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+17:15772:x1875740189610240:12345-0@lo:501:mount.lustre.0 Request processed in 613us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845534.097172:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788845534.097289:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845534.097331:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610368:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788845534.097409:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845534.097670:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845534.097741:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189610368 00000100:00100000:3.0:1788845534.097747:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189610368 00000100:00100000:3.0:1788845534.097777:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788845534.097784:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+17:15772:x1875740189610368:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788845534.098160:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+17:15772:x1875740189610368:12345-0@lo:503:mount.lustre.0 Request processed in 375us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845534.098168:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788845534.098290:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610368:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788845534.099231:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788845534.099304:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788845534.099408:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845534.099703:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845534.099746:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189610496 00000100:00100000:3.0:1788845534.099752:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189610496 00000100:00100000:3.0:1788845534.099823:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788845534.099831:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+17:15772:x1875740189610496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788845534.100155:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+17:15772:x1875740189610496:12345-0@lo:502:mount.lustre.0 Request processed in 324us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845534.100163:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788845534.100252:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610496:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788845534.100975:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788845534.101040:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788845534.101068:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788845534.101108:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788845534.101146:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788845534.101181:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788845534.101229:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788845534.101265:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788845534.101306:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788845534.101341:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788845534.101424:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845534.101467:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788845534.101545:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189610624 00000100:00100000:1.0:1788845534.101618:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189610624 00000100:00100000:1.0:1788845534.101662:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788845534.101671:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+17:15772:x1875740189610624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788845534.101964:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+17:15772:x1875740189610624:12345-0@lo:502:mount.lustre.0 Request processed in 185us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845534.101972:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788845534.102060:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788845534.102134:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788845534.102144:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788845534.103253:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788845534.103263:0:15773:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788845534.103270:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845534.103273:0:15773:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788845534.103280:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788845534.103296:0:15773:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92aeae5119b8) 00000020:00000080:1.0:1788845534.103334:0:15773:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788845534.103341:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788845534.103484:0:15773:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92ae885b2800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788845534.103493:0:15773:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788845534.103500:0:15773:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd8041b54d6dfa924 00010000:00010000:0.0:1788845534.107731:0:15773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788845534.108218:0:15773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1788845534.110162:0:15773:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788845534.112144:0:15773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788845534.112158:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845534.112164:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845534.112167:0:15773:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788845534.112170:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845534.112174:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845534.112175:0:15773:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788845534.112178:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788845534.112181:0:15773:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788845534.112183:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845534.112185:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845534.112187:0:15773:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788845534.112189:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845534.112191:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845534.112198:0:15773:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788845534.112203:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788845534.112276:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845534.112280:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845534.112281:0:15773:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788845534.112284:0:15773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788845534.112494:0:15772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788845534.112626:0:15772:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788845534.112651:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1600/0xd8041b54d6dfa90f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa916 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.112665:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd1600/0xd8041b54d6dfa90f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa916 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845534.112675:0:15772:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ae885b2800 from 1 10000000:01000000:3.0:1788845534.112678:0:15772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788845534.112713:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.112723:0:15772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.112733:0:15772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845534.112772:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc681880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788845534.112841:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845534.112892:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98ef90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845534.113002:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189610752 00000100:00100000:1.0:1788845534.113010:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189610752 00000100:00100000:1.0:1788845534.113060:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788845534.113070:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+17:15772:x1875740189610752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788845534.113083:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845534.113101:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6dfa932 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa92b expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.113124:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6dfa932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa92b expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.113135:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6dfa932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa92b expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.113143:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08a00, rc 0) 00000100:00100000:1.0:1788845534.113190:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+18:15772:x1875740189610752:12345-0@lo:101:mount.lustre.0 Request processed in 122us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845534.113197:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788845534.113278:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc681880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788845534.113291:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845534.113301:0:15772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788845534.113930:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788845534.114231:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845534.114504:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788845534.115752:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788845534.115901:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788845534.115910:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788845534.115993:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788845534.116054:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845534.116678:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04900 going to sleep for 11 seconds 00000100:00100000:3.0:1788845534.118020:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189610880 00000100:00100000:3.0:1788845534.118032:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189610880 00000100:00100000:3.0:1788845534.118131:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788845534.118142:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+18:15772:x1875740189610880:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788845534.118488:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+18:15772:x1875740189610880:12345-0@lo:501:mount.lustre.0 Request processed in 347us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845534.118497:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788845534.118612:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189610880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788845534.118664:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788845534.118718:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845534.122044:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189611008 00000100:00100000:1.0:1788845534.122060:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189611008 00000100:00100000:2.0:1788845534.122084:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae82d58300 going to sleep for 11 seconds 00000100:00100000:1.0:1788845534.122111:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788845534.122122:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+18:15772:x1875740189611008:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788845534.126127:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+18:15772:x1875740189611008:12345-0@lo:503:mount.lustre.0 Request processed in 3994us (7396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845534.126142:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788845534.126322:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611008:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788845534.127743:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788845534.128050:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788845534.128142:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845534.128246:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45840 going to sleep for 11 seconds 00000100:00100000:3.0:1788845534.128351:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189611136 00000100:00100000:3.0:1788845534.128359:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189611136 00000100:00100000:3.0:1788845534.129985:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788845534.129996:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+18:15772:x1875740189611136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788845534.130403:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+18:15772:x1875740189611136:12345-0@lo:502:mount.lustre.0 Request processed in 407us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845534.130411:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788845534.133243:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788845534.133879:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788845534.133951:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788845534.134004:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788845534.134040:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788845534.134083:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788845534.134124:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788845534.134154:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788845534.134180:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788845534.134219:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788845534.137159:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845534.137203:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fe45840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845534.137399:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189611264 00000100:00100000:1.0:1788845534.137409:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189611264 00000100:00100000:1.0:1788845534.137463:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788845534.137473:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+18:15772:x1875740189611264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788845534.137795:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+18:15772:x1875740189611264:12345-0@lo:502:mount.lustre.0 Request processed in 322us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845534.137805:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788845534.138166:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788845534.138354:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788845534.138386:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788845534.139492:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845534.139513:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845534.139516:0:15777:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788845534.139525:0:15777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ae885b2800 00000020:00000080:0.0:1788845534.139528:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788845534.139537:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845534.139540:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845534.139542:0:15777:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788845534.139545:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845534.139576:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845534.139577:0:15777:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788845534.139582:0:15777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ae885b2800 00000020:00000080:0.0:1788845534.139585:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788845534.139656:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845534.139660:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845534.139662:0:15777:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788845534.139665:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845534.139667:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845534.139669:0:15777:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788845534.139674:0:15777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92ae885b2800 00000020:00000080:0.0:1788845534.139676:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788845534.139715:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845534.139719:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845534.139720:0:15777:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788845534.139724:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788845534.140350:0:15772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788845534.140427:0:15772:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845534.140450:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.140463:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845534.140528:0:15772:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788845534.140537:0:15772:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92ae885b2800 10000000:01000000:3.0:1788845534.140540:0:15772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92ae885b2800 10000000:01000000:3.0:1788845534.140544:0:15772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845534.140550:0:15772:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ae885b2800 from 1 10000000:01000000:3.0:1788845534.140552:0:15772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788845534.140584:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748b200/0xd8041b54d6dfa939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.140592:0:15772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92aeb748b200/0xd8041b54d6dfa939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.140601:0:15772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92aeb748b200/0xd8041b54d6dfa939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845534.140625:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc681500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788845534.140687:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845534.140739:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189611392 00000100:00100000:3.0:1788845534.140741:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ebb19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845534.140747:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189611392 00000100:00100000:0.0:1788845534.140804:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788845534.140815:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+18:15772:x1875740189611392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788845534.140828:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845534.140841:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6dfa940 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa939 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845534.140865:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6dfa940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa939 expref: 19 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845534.140875:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1ee00/0xd8041b54d6dfa940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa939 expref: 19 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845534.140885:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1ee00, rc 0) 00000100:00100000:0.0:1788845534.140933:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+19:15772:x1875740189611392:12345-0@lo:101:mount.lustre.0 Request processed in 120us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845534.140948:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788845534.140979:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc681500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788845534.141000:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92aeb748b200/0xd8041b54d6dfa939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa940 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.141010:0:15772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92aeb748b200/0xd8041b54d6dfa939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa940 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788845534.141669:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788845534.142421:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788845534.142713:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788845534.142762:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788845534.142798:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788845534.142869:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788845534.142909:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788845534.142979:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788845534.143013:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788845534.143042:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788845534.143083:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788845534.143114:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788845534.143147:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788845534.143196:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788845534.143231:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788845534.143263:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788845534.143311:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788845534.143347:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788845534.143418:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788845534.143470:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788845534.143519:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788845534.143555:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788845534.143597:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788845534.143650:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788845534.143682:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788845534.143728:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788845534.143775:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788845534.144905:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788845534.145014:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788845534.145076:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788845534.145133:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788845534.145209:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788845534.145256:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788845534.145293:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788845534.145334:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788845534.146872:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788845534.146969:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788845534.147054:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788845534.147114:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788845534.147293:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788845534.147303:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788845534.147431:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788845534.147569:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845534.154886:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845534.159732:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189611520 00000100:00100000:2.0:1788845534.159749:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189611520 00000100:00100000:2.0:1788845534.160224:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788845534.160236:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+19:15772:x1875740189611520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788845534.161353:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+19:15772:x1875740189611520:12345-0@lo:501:mount.lustre.0 Request processed in 1114us (13778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845534.161387:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788845534.161705:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788845534.161761:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788845534.162013:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845534.162057:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788845534.162101:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189611648 00000100:00100000:0.0:1788845534.162109:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189611648 00000100:00100000:0.0:1788845534.162150:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788845534.162159:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+19:15772:x1875740189611648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788845534.162356:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+19:15772:x1875740189611648:12345-0@lo:503:mount.lustre.0 Request processed in 197us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845534.162395:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788845534.162637:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611648:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788845534.167419:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788845534.167541:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788845534.167650:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845534.167700:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fc04900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845534.168456:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189611776 00000100:00100000:2.0:1788845534.168466:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189611776 00000100:00100000:2.0:1788845534.168533:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788845534.168547:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+19:15772:x1875740189611776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788845534.168865:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+19:15772:x1875740189611776:12345-0@lo:502:mount.lustre.0 Request processed in 321us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845534.168874:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788845534.169032:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788845534.169321:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788845534.169397:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788845534.169516:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788845534.169573:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788845534.169662:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788845534.169729:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788845534.171556:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788845534.171951:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788845534.172030:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788845534.172070:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788845534.172100:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788845534.172142:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788845534.172176:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788845534.172219:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788845534.172265:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788845534.172321:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788845534.172396:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788845534.172846:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788845534.172895:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788845534.172932:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788845534.173059:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788845534.173099:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788845534.173137:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788845534.173201:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788845534.173260:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788845534.173319:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788845534.173450:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788845534.173501:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788845534.173558:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788845534.173621:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788845534.173655:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788845534.173681:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788845534.173707:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788845534.173745:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788845534.173774:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788845534.173816:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788845534.173847:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788845534.173874:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788845534.173915:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788845534.173953:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788845534.174124:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc683100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788845534.174205:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845534.174259:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9ebb19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845534.174707:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189611904 00000100:00100000:2.0:1788845534.174716:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189611904 00000100:00100000:2.0:1788845534.174781:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788845534.174793:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+19:15772:x1875740189611904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788845534.175123:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+19:15772:x1875740189611904:12345-0@lo:502:mount.lustre.0 Request processed in 332us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845534.175131:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788845534.175618:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc683100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189611904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788845534.175740:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788845534.175754:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788845534.178467:0:15782:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788845534.178487:0:15782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff92ae8ff099b8) 00000020:00000080:2.0:1788845534.178525:0:15782:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788845534.178873:0:15782:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92ae885b2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788845534.178879:0:15782:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92ae885b2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788845534.178881:0:15782:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ae885b2800 3 00010000:00080000:3.0:1788845534.178917:0:15782:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92aeb7593800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.135@tcp at head 00010000:00010000:3.0:1788845534.180769:0:15782:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788845534.180991:0:15782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788845534.181027:0:15782:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788845534.181040:0:15782:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd8041b54d6dfa94e 00000100:00080000:3.0:1788845534.181050:0:15782:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788845534.181056:0:15782:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92aeb7593800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1788845534.181091:0:15782:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aebc683100 x1875740189612032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788845534.181122:0:15782:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788845534.181155:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788845534.181160:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788845534.181163:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788845534.181166:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788845534.181231:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189612160:0@lo:400:kworker.0 00000100:00100000:0.0:1788845534.181263:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189612288:0@lo:400:kworker.0 00000100:00100000:3.0:1788845534.181296:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845534.181383:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875740189612032:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788845534.181642:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845534.181700:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189612160 00000100:00100000:2.0:1788845534.181707:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189612160 00000100:00100000:2.0:1788845534.181759:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189612032 00000100:00100000:2.0:1788845534.181763:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189612032 00000100:00100000:2.0:1788845534.181777:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788845534.181789:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189612160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845534.181838:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189612160:12345-0@lo:400:kworker.0 Request processed in 52us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845534.181846:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788845534.181864:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788845534.181869:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875740189612032:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788845534.181898:0:14373:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:2.0:1788845534.181930:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd8041b54d6dfa955 00000004:00100000:2.0:1788845534.181945:0:14373:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788845534.181986:0:14373:0:(import.c:65:import_set_state_nolock()) ffff92ae90d30800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845534.182111:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875740189612032:12345-0@lo:38:llog_process_th.0 Request processed in 239us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845534.182118:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788845534.182156:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc683100 x1875740189612032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845534.182166:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788845534.182185:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788845534.182193:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788845534.182197:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788845534.182200:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92aeb7593800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788845534.182205:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875740189612032:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788845534.184232:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc681f80 x1875740189612160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845534.184252:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189612160:0@lo:400:kworker.0 00000100:00100000:0.0:1788845534.185236:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845534.185299:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189612288 00000100:00100000:0.0:1788845534.185306:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189612288 00000100:00100000:0.0:1788845534.185380:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788845534.185390:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189612288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845534.185457:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189612288:12345-0@lo:400:kworker.0 Request processed in 69us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845534.185463:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788845534.185483:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788845534.185518:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92aebc681500 x1875740189612288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845534.185529:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189612288:0@lo:400:kworker.0 00000040:00080000:1.0:1788845534.188396:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788845534.190462:0:15772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788845534.190524:0:15772:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788845534.190582:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92aeb748b200/0xd8041b54d6dfa939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa940 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.190597:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92aeb748b200/0xd8041b54d6dfa939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa940 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788845534.190659:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788845534.190661:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788845534.190663:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845534.190664:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845534.190666:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845534.190667:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845534.190669:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845534.190670:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845534.190672:0:15772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788845534.190676:0:15772:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788845534.190679:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788845534.190681:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788845534.190682:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845534.190683:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845534.190684:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845534.190686:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845534.190687:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845534.190688:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845534.190689:0:15772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788845534.190714:0:15772:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788845534.190734:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189612416:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788845534.190803:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845534.190845:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98ef90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845534.192247:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189612416 00000100:00100000:2.0:1788845534.192258:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189612416 00000100:00100000:2.0:1788845534.192326:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788845534.192338:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+19:15772:x1875740189612416:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788845534.192389:0:14366:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788845534.192409:0:14366:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1788845534.239014:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788845534.247388:0:14366:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788845534.247403:0:14366:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788845534.247649:0:14389:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788845534.247655:0:14389:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788845534.247679:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.247720:0:14389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa8f3 expref: 19 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.247728:0:14389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.247769:0:14389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6dfa8f3 expref: 19 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.247784:0:14389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa8fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6dfa8f3 expref: 19 pid: 14366 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845534.247800:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14389:1875740189612544:0@lo:104: 00000100:00100000:1.0:1788845534.247869:0:14389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845534.247933:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aebbcc3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845534.247971:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189612544 00000100:00100000:0.0:1788845534.247988:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189612544 00000100:00100000:0.0:1788845534.248040:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845534.248049:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d9107f4-aa08-4701-832e-746d9df521c4+3:14389:x1875740189612544:12345-0@lo:104: 00010000:00010000:0.0:1788845534.248061:0:14357:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845534.248204:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14389:1875740189612544:0@lo:104: 00010000:00010000:1.0:1788845534.248222:0:14389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845534.248278:0:14357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845534.248285:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d9107f4-aa08-4701-832e-746d9df521c4+3:14389:x1875740189612544:12345-0@lo:104: Request processed in 237us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845534.248293:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788845534.248351:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845534.248357:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.248390:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0a00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:1.0:1788845534.248394:0:14361:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.248403:0:14361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845534.248425:0:14361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845534.248430:0:14361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845534.248454:0:14361:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.248460:0:14361:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845534.248485:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.248492:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aeb7fd0a00/0xd8041b54d6dfa8f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa8fa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845534.248521:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845534.248523:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845534.248525:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845534.248533:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845534.248544:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d9107f4-aa08-4701-832e-746d9df521c4:3283:1875740189612672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788845534.248573:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845534.248992:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189612672 00000100:00100000:3.0:1788845534.248999:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189612672 00010000:00010000:3.0:1788845534.249026:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa8fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa8f3 expref: 20 pid: 14366 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845534.249058:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845534.249071:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d9107f4-aa08-4701-832e-746d9df521c4+20:3283:x1875740189612672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845534.249083:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845534.249089:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa8fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa8f3 expref: 20 pid: 14366 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.249100:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6dfa8f3 expref: 20 pid: 14366 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.249115:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fc09e00/0xd8041b54d6dfa8fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6dfa8f3 expref: 20 pid: 14366 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.249128:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.249135:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788845534.249150:0:14359:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001914831s 00010000:00010000:3.0:1788845534.249155:0:14359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.249163:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.249180:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.249187:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.249192:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845534.249203:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.249212:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.249235:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845534.249245:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845534.249287:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d9107f4-aa08-4701-832e-746d9df521c4+19:3283:x1875740189612672:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845534.249294:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845534.249333:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d9107f4-aa08-4701-832e-746d9df521c4:3283:1875740189612672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845534.249394:0:14389:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845534.249403:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845534.249418:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfa95c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845534.265408:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+18:15772:x1875740189612416:12345-0@lo:253:mount.lustre.0 Request processed in 73022us (74552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845534.265424:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788845534.265551:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d9107f4-aa08-4701-832e-746d9df521c4:15772:1875740189612416:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788845534.265569:0:15772:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788845534.265572:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788845534.265574:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788845534.265575:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845534.265576:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845534.265578:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845534.265579:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845534.265580:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845534.265582:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845534.265584:0:15772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788845534.265599:0:15772:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788845534.274116:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788845534.274419:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788845534.274608:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788845534.274760:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788845534.274917:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788845534.275584:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788845534.276437:0:15772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788845534.352044:0:15772:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788845534.352056:0:15772:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788845534.352090:0:15772:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788845534.352163:0:15772:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788845534.352200:0:15772:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788845534.352237:0:15772:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000040:00080000:2.0:1788845534.499667:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788845535.269187:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788845536.095833:0:14370:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788845536.095844:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92aeadcb1000 from 8 10000000:01000000:0.0:1788845536.095853:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788845536.095904:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f400/0xd8041b54d6dfa963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.095917:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f400/0xd8041b54d6dfa963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.095928:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f400/0xd8041b54d6dfa963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845536.095957:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189612800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845536.096033:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845536.096089:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae91b8bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845536.096115:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189612800 00000100:00100000:0.0:1788845536.096122:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189612800 00000100:00100000:0.0:1788845536.096193:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788845536.096203:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+18:14370:x1875740189612800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845536.096215:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845536.096229:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1fe00/0xd8041b54d6dfa96a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfa963 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.096251:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1fe00/0xd8041b54d6dfa96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfa963 expref: 19 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.096262:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1fe00/0xd8041b54d6dfa96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa963 expref: 19 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.096298:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1fe00, rc 0) 00000100:00100000:0.0:1788845536.096338:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+19:14370:x1875740189612800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845536.096345:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788845536.096414:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189612800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845536.096428:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f400/0xd8041b54d6dfa963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa96a expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.096437:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f400/0xd8041b54d6dfa963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfa96a expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845536.096487:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189612928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788845536.096534:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845536.096549:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae91b8bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845536.096563:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189612928 00000100:00100000:0.0:1788845536.096568:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189612928 00000100:00100000:0.0:1788845536.096591:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788845536.096597:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+19:14370:x1875740189612928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788845536.096612:0:14366:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788845536.096632:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788845536.096635:0:14366:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788845536.096715:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+19:14370:x1875740189612928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845536.096722:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788845536.096753:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189612928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788845536.096817:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788845536.096824:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f400/0xd8041b54d6dfa963 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa96a expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.096831:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fd1f400/0xd8041b54d6dfa963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfa96a expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845536.222010:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788845521/real 1788845521] req@ffff92ad82f4c000 x1875740189605504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788845536 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845536.222052:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92ad82f4c000 x1875740189605504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788845536 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845536.222065:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788845521/real 1788845521] req@ffff92ad82f4ea00 x1875740189605632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788845536 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845536.222077:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92ad82f4ea00 x1875740189605632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788845536 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788845536.222097:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92ae93186800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788845536.222123:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788845536.222128:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189605504:0@lo:8:kworker.0 00000100:00080000:0.0:1788845536.222135:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92aeb95b0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788845536.222142:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788845536.222147:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189605632:0@lo:8:kworker.0 00000100:00080000:3.0:1788845536.222592:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788845536.222606:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788845536.222609:0:36:0:(import.c:65:import_set_state_nolock()) ffff92ae93186800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788845536.222614:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 330 00000100:00080000:3.0:1788845536.222619:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788845536.222626:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92ae93186800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1788845536.222671:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aebc681f80 x1875740189613056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788845536.222694:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788845536.222698:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788845536.222699:0:36:0:(import.c:65:import_set_state_nolock()) ffff92aeb95b0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788845536.222702:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 330 00000100:00080000:3.0:1788845536.222705:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788845536.222709:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92aeb95b0800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1788845536.222722:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92aebc680380 x1875740189613184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788845536.222807:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189613440:0@lo:400:kworker.0 00000100:00100000:3.0:1788845536.222882:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845536.222939:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845536.222947:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189613312:0@lo:400:kworker.0 00000100:00100000:3.0:1788845536.222971:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845536.222995:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845536.223002:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189613568:0@lo:400:kworker.0 00000100:00100000:3.0:1788845536.223036:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845536.223063:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189613440 00000100:00100000:3.0:1788845536.223070:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189613440 00000100:00100000:3.0:1788845536.223132:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189613312 00000100:00100000:3.0:1788845536.223135:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189613312 00000100:00100000:3.0:1788845536.223149:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189613568 00000100:00100000:3.0:1788845536.223151:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189613568 00000100:00100000:3.0:1788845536.223185:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788845536.223195:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189613440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845536.223249:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189613440:12345-0@lo:400:kworker.0 Request processed in 55us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845536.223256:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788845536.223273:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845536.223279:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189613312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845536.223326:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189613312:12345-0@lo:400:kworker.0 Request processed in 46us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845536.223332:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845536.223344:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788845536.223351:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189613568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845536.223416:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189613568:12345-0@lo:400:kworker.0 Request processed in 66us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845536.223423:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788845536.223446:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788845536.223472:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc683b80 x1875740189613568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845536.223483:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189613568:0@lo:400:kworker.0 00010000:00080000:3.0:1788845536.223574:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc682680 x1875740189613312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845536.223583:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189613312:0@lo:400:kworker.0 00010000:00080000:3.0:1788845536.223602:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc682a00 x1875740189613440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845536.223609:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189613440:0@lo:400:kworker.0 00000100:00100000:0.0:1788845536.229921:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189613056:0@lo:8:kworker.0 00000100:00100000:0.0:1788845536.230256:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845536.230434:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189613184:0@lo:8:kworker.0 00000100:00100000:0.0:1788845536.230466:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845536.230978:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189613056 00000100:00100000:3.0:1788845536.230989:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189613056 00000100:00100000:1.0:1788845536.231150:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189613184 00000100:00100000:1.0:1788845536.231155:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189613184 00000100:00100000:1.0:1788845536.231201:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845536.231209:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875740189613056:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788845536.231239:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 345 last 0 00000020:00000080:1.0:1788845536.231274:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd8041b54d6dfa971 00002000:00100000:1.0:1788845536.231452:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff92ad837c9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788845536.231457:0:15055:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788845536.231460:0:15055:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788845536.231997:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788845536.232025:0:15055:0:(import.c:65:import_set_state_nolock()) ffff92ad837cb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845536.232106:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875740189613056:12345-0@lo:8:kworker.0 Request processed in 896us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845536.232114:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845536.232137:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845536.232142:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875740189613184:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788845536.232161:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 345 last 0 00000020:00000080:1.0:1788845536.232180:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd8041b54d6dfa978 00002000:00100000:1.0:1788845536.232188:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff92ad837cb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788845536.232192:0:15055:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788845536.232194:0:15055:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788845536.232591:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788845536.232608:0:15055:0:(import.c:65:import_set_state_nolock()) ffff92ad837cc000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1788845536.232956:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc681f80 x1875740189613056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788845556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845536.232969:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788845536.232977:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788845536.232986:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788845536.232991:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788845536.232993:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92ae93186800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788845536.233016:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788845536.233022:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189613056:0@lo:8:kworker.0 00000004:00080000:3.0:1788845536.233133:0:14396:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788845536.233166:0:14396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14396:1875740189613824:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788845536.233216:0:14396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845536.233242:0:14396:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ad82f71780 going to sleep for 11 seconds 00000004:00080000:3.0:1788845536.233259:0:14395:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788845536.233403:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189613696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845536.233438:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788845536.234012:0:14395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345453647931ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788845536.234049:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788845536.234057:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788845536.234192:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189613824 00000100:00100000:3.0:1788845536.234199:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189613824 00000100:00080000:3.0:1788845536.234254:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845536.237512:0:15883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845536.237531:0:15883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14396:x1875740189613824:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788845536.240476:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189613696 00000100:00100000:1.0:1788845536.240489:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189613696 00000100:00100000:1.0:1788845536.240552:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845536.240563:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875740189613696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845536.240599:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845536.241389:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875740189613696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 724us (7846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845536.241400:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845536.242145:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875740189613184:12345-0@lo:8:kworker.0 Request processed in 9996us (11673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845536.242162:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788845536.242489:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc682a00 x1875740189613696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845536.242526:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189613696:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788845536.242564:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc680380 x1875740189613184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788845556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845536.242573:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788845536.242579:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788845536.242588:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788845536.242592:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788845536.242596:0:3282:0:(import.c:65:import_set_state_nolock()) ffff92aeb95b0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788845536.242616:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788845536.242623:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875740189613184:0@lo:8:kworker.0 00000004:00080000:2.0:1788845536.242628:0:14397:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788845536.243091:0:14397:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345462727953ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788845536.243468:0:14398:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788845536.243515:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14398:1875740189614080:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788845536.243575:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845536.243603:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae82f036c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845536.243621:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189613952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845536.243956:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845536.244073:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189613952 00000100:00100000:1.0:1788845536.244081:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189613952 00000100:00100000:1.0:1788845536.244142:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845536.244152:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875740189613952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845536.244182:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845536.244230:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875740189613952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845536.244237:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788845536.244403:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788845536.244431:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aeadc84380 x1875740189613952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845536.244447:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189613952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845536.244540:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189614080 00000100:00100000:3.0:1788845536.244545:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189614080 00000100:00100000:3.0:1788845536.244582:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845536.244590:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14398:x1875740189614080:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788845536.250516:0:15883:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788845536.250530:0:15883:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788845536.250544:0:15883:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00080000:3.0:1788845536.252239:0:15054:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788845536.252249:0:15054:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788845536.252255:0:15054:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1788845536.260685:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.260699:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeacad81/0xd8041b54d6dfa97f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.260716:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.260793:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.260801:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeacad81/0xd8041b54d6dfa97f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.260818:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeacad81/0xd8041b54d6dfa97f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.260829:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeacad81/0xd8041b54d6dfa97f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.260836:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeacad81/0xd8041b54d6dfa97f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.260864:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788845536.260879:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845536.260885:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeacad81/0xd8041b54d6dfa97f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.260893:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845536.260898:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeacad81/0xd8041b54d6dfa97f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.260922:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeacad81/0xd8041b54d6dfa97f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.260938:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeacad81/0xd8041b54d6dfa97f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.260944:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeacad81/0xd8041b54d6dfa97f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.260974:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.260976:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.260977:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.261703:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.261711:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6ce1ac1/0xd8041b54d6dfa986 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.261789:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.261794:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.261800:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6ce1ac1/0xd8041b54d6dfa986 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.261810:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6ce1ac1/0xd8041b54d6dfa986 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.261818:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6ce1ac1/0xd8041b54d6dfa986 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.261833:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6ce1ac1/0xd8041b54d6dfa986 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.261853:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788845536.261865:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845536.261870:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6ce1ac1/0xd8041b54d6dfa986 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.261878:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845536.261882:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6ce1ac1/0xd8041b54d6dfa986 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.261891:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6ce1ac1/0xd8041b54d6dfa986 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.261904:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6ce1ac1/0xd8041b54d6dfa986 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.261911:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6ce1ac1/0xd8041b54d6dfa986 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.261930:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.261932:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.261933:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.262526:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.262542:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a669997d/0xd8041b54d6dfa98d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.262552:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.262556:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.262560:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a669997d/0xd8041b54d6dfa98d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.262571:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a669997d/0xd8041b54d6dfa98d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.262579:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a669997d/0xd8041b54d6dfa98d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.262586:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a669997d/0xd8041b54d6dfa98d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.262602:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788845536.262613:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845536.262617:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a669997d/0xd8041b54d6dfa98d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.262624:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1c00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845536.262627:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a669997d/0xd8041b54d6dfa98d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.262636:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a669997d/0xd8041b54d6dfa98d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.262654:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a669997d/0xd8041b54d6dfa98d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.262661:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a669997d/0xd8041b54d6dfa98d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.262677:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.262679:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.262681:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.263829:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.263840:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010dc4cf1/0xd8041b54d6dfa994 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.263853:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.263857:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.263862:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010dc4cf1/0xd8041b54d6dfa994 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.263873:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010dc4cf1/0xd8041b54d6dfa994 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.263882:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010dc4cf1/0xd8041b54d6dfa994 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.263890:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010dc4cf1/0xd8041b54d6dfa994 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.263969:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788845536.264444:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.264450:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ea2719/0xd8041b54d6dfa99b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.264459:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.264462:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.264467:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ea2719/0xd8041b54d6dfa99b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.264476:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ea2719/0xd8041b54d6dfa99b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.264484:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ea2719/0xd8041b54d6dfa99b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.264492:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ea2719/0xd8041b54d6dfa99b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.264704:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788845536.264712:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010dc4cf1/0xd8041b54d6dfa994 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.264728:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.264733:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010dc4cf1/0xd8041b54d6dfa994 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.264743:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010dc4cf1/0xd8041b54d6dfa994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.264761:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010dc4cf1/0xd8041b54d6dfa994 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.264769:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010dc4cf1/0xd8041b54d6dfa994 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.264801:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845536.264804:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ea2719/0xd8041b54d6dfa99b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.264811:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.264814:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ea2719/0xd8041b54d6dfa99b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.264821:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ea2719/0xd8041b54d6dfa99b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.264829:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ea2719/0xd8041b54d6dfa99b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.264835:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.264836:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.264838:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.264947:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788845536.264953:0:15883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ea2719/0xd8041b54d6dfa99b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.265377:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.265384:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9fa99de/0xd8041b54d6dfa9a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.265397:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.265400:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.265404:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9fa99de/0xd8041b54d6dfa9a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.265412:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9fa99de/0xd8041b54d6dfa9a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.265430:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9fa99de/0xd8041b54d6dfa9a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.265436:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9fa99de/0xd8041b54d6dfa9a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.265579:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845536.265585:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9fa99de/0xd8041b54d6dfa9a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.265593:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.265596:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9fa99de/0xd8041b54d6dfa9a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.265614:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9fa99de/0xd8041b54d6dfa9a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.265626:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9fa99de/0xd8041b54d6dfa9a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.265633:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.265634:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.265636:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.265689:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788845536.265694:0:15883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9fa99de/0xd8041b54d6dfa9a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.266072:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.266078:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000def19267/0xd8041b54d6dfa9a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.266086:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.266089:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.266093:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000def19267/0xd8041b54d6dfa9a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.266112:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000def19267/0xd8041b54d6dfa9a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.266120:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000def19267/0xd8041b54d6dfa9a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.266127:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000def19267/0xd8041b54d6dfa9a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.266553:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845536.266559:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000def19267/0xd8041b54d6dfa9a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.266567:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.266571:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000def19267/0xd8041b54d6dfa9a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.266579:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000def19267/0xd8041b54d6dfa9a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.266591:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000def19267/0xd8041b54d6dfa9a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.266600:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.266601:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.266603:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.266699:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788845536.266704:0:15883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000def19267/0xd8041b54d6dfa9a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.267166:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.267173:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094317210/0xd8041b54d6dfa9b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.267182:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.267185:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.267190:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094317210/0xd8041b54d6dfa9b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.267200:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094317210/0xd8041b54d6dfa9b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.267224:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094317210/0xd8041b54d6dfa9b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.267232:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094317210/0xd8041b54d6dfa9b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.267343:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845536.267349:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094317210/0xd8041b54d6dfa9b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.267356:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0c00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.267359:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094317210/0xd8041b54d6dfa9b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.267391:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094317210/0xd8041b54d6dfa9b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.267403:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094317210/0xd8041b54d6dfa9b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.267410:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.267412:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.267414:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.267567:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788845536.267572:0:15883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094317210/0xd8041b54d6dfa9b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.268002:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.268008:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd47990/0xd8041b54d6dfa9b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.268018:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.268021:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.268025:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd47990/0xd8041b54d6dfa9b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.268035:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd47990/0xd8041b54d6dfa9b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.268043:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd47990/0xd8041b54d6dfa9b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.268062:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bd47990/0xd8041b54d6dfa9b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.268141:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845536.268147:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bd47990/0xd8041b54d6dfa9b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.268154:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1a00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.268158:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd47990/0xd8041b54d6dfa9b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.268166:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd47990/0xd8041b54d6dfa9b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.268192:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bd47990/0xd8041b54d6dfa9b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.268200:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.268202:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.268204:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.268267:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788845536.268273:0:15883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd47990/0xd8041b54d6dfa9b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.268915:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.268921:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee989dab/0xd8041b54d6dfa9be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.268931:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.268934:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.268938:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee989dab/0xd8041b54d6dfa9be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.268946:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee989dab/0xd8041b54d6dfa9be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.268953:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee989dab/0xd8041b54d6dfa9be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.268960:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee989dab/0xd8041b54d6dfa9be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.269019:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845536.269024:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee989dab/0xd8041b54d6dfa9be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.269031:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.269034:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee989dab/0xd8041b54d6dfa9be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.269042:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee989dab/0xd8041b54d6dfa9be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.269055:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee989dab/0xd8041b54d6dfa9be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.269063:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.269064:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.269066:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.269124:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788845536.269128:0:15883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee989dab/0xd8041b54d6dfa9be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.269679:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.269685:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000266bb22/0xd8041b54d6dfa9c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.269695:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.269699:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.269704:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000266bb22/0xd8041b54d6dfa9c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.269713:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000266bb22/0xd8041b54d6dfa9c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.269794:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000266bb22/0xd8041b54d6dfa9c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.269802:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000266bb22/0xd8041b54d6dfa9c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.269848:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845536.269854:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000266bb22/0xd8041b54d6dfa9c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.269871:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd1e00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.269875:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000266bb22/0xd8041b54d6dfa9c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.269883:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000266bb22/0xd8041b54d6dfa9c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.269896:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000266bb22/0xd8041b54d6dfa9c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.269905:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.269906:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.269908:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.269977:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788845536.269983:0:15883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000266bb22/0xd8041b54d6dfa9c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.270448:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.270454:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa9cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.270463:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.270467:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.270471:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.270480:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.270487:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.270502:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa9cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.270953:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845536.270961:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa9cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.270969:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0a00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.270974:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa9cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.270984:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa9cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.270997:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa9cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.271015:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.271017:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.271020:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.272321:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788845536.272333:0:15883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d359cb3/0xd8041b54d6dfa9cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.272392:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.276297:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.276311:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c6ea7d/0xd8041b54d6dfa9d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.276337:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.276342:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.276349:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032c6ea7d/0xd8041b54d6dfa9d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.276389:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032c6ea7d/0xd8041b54d6dfa9d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.276399:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c6ea7d/0xd8041b54d6dfa9d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.276406:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032c6ea7d/0xd8041b54d6dfa9d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.276491:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788845536.276507:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845536.276516:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032c6ea7d/0xd8041b54d6dfa9d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.276527:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb7fd0e00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.276532:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c6ea7d/0xd8041b54d6dfa9d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.276541:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c6ea7d/0xd8041b54d6dfa9d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.276559:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032c6ea7d/0xd8041b54d6dfa9d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.276569:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.276571:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.276572:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.277815:0:15883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032c6ea7d/0xd8041b54d6dfa9d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.279612:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.279624:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091b45074/0xd8041b54d6dfa9da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.279642:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.279647:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.279652:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091b45074/0xd8041b54d6dfa9da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.279679:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091b45074/0xd8041b54d6dfa9da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.279689:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091b45074/0xd8041b54d6dfa9da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.279697:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091b45074/0xd8041b54d6dfa9da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.279716:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788845536.279741:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845536.279747:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091b45074/0xd8041b54d6dfa9da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.279755:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81480800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845536.279759:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091b45074/0xd8041b54d6dfa9da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.279767:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091b45074/0xd8041b54d6dfa9da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.279784:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091b45074/0xd8041b54d6dfa9da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.279790:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091b45074/0xd8041b54d6dfa9da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.279821:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.279824:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.279827:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.280792:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.280800:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a89b89d/0xd8041b54d6dfa9e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.280812:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.280815:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.280821:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a89b89d/0xd8041b54d6dfa9e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.280832:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a89b89d/0xd8041b54d6dfa9e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.280840:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a89b89d/0xd8041b54d6dfa9e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.280847:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a89b89d/0xd8041b54d6dfa9e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.280867:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788845536.280880:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845536.280885:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a89b89d/0xd8041b54d6dfa9e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.280905:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81480e00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845536.280908:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a89b89d/0xd8041b54d6dfa9e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.280916:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a89b89d/0xd8041b54d6dfa9e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.280928:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a89b89d/0xd8041b54d6dfa9e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.280935:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a89b89d/0xd8041b54d6dfa9e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.280952:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.280953:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.280955:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.282413:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.282436:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089652e19/0xd8041b54d6dfa9e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.282452:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.282456:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.282462:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089652e19/0xd8041b54d6dfa9e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.282474:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089652e19/0xd8041b54d6dfa9e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.282491:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089652e19/0xd8041b54d6dfa9e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.282509:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089652e19/0xd8041b54d6dfa9e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.282530:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788845536.282541:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845536.282545:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089652e19/0xd8041b54d6dfa9e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.282553:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845536.282557:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089652e19/0xd8041b54d6dfa9e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.282564:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089652e19/0xd8041b54d6dfa9e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.282577:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089652e19/0xd8041b54d6dfa9e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.282584:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089652e19/0xd8041b54d6dfa9e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.282604:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.282614:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.282616:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.283216:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.283222:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d901a2f9/0xd8041b54d6dfa9ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.283233:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.283237:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.283241:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d901a2f9/0xd8041b54d6dfa9ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.283251:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d901a2f9/0xd8041b54d6dfa9ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.283259:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d901a2f9/0xd8041b54d6dfa9ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.283266:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d901a2f9/0xd8041b54d6dfa9ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.283285:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788845536.283296:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845536.283300:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d901a2f9/0xd8041b54d6dfa9ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.283307:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481a00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845536.283310:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d901a2f9/0xd8041b54d6dfa9ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.283328:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d901a2f9/0xd8041b54d6dfa9ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.283340:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d901a2f9/0xd8041b54d6dfa9ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.283347:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d901a2f9/0xd8041b54d6dfa9ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.283385:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.283387:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.283389:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.285010:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.285024:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed325073/0xd8041b54d6dfa9f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.285041:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.285046:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.285052:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed325073/0xd8041b54d6dfa9f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.285064:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed325073/0xd8041b54d6dfa9f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.285073:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed325073/0xd8041b54d6dfa9f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.285086:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed325073/0xd8041b54d6dfa9f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.285113:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788845536.286218:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.286228:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed325073/0xd8041b54d6dfa9f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.286247:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481e00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.286252:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed325073/0xd8041b54d6dfa9f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.287251:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed325073/0xd8041b54d6dfa9f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.287278:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed325073/0xd8041b54d6dfa9f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.287286:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed325073/0xd8041b54d6dfa9f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.287322:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.287325:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.287327:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845536.287572:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788845536.287835:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.287844:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6dfa9fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.287857:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.287861:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.287867:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6dfa9fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.287884:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6dfa9fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.287902:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6dfa9fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.287909:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6dfa9fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.287933:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788845536.287966:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845536.287974:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6dfa9fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.287985:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.287991:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6dfa9fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.288001:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6dfa9fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.288020:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6dfa9fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.288029:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006789187e/0xd8041b54d6dfa9fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.288064:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845536.288068:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845536.288071:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788845536.288545:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.288552:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecfb6ec9/0xd8041b54d6dfaa04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.288563:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.288566:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.288571:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecfb6ec9/0xd8041b54d6dfaa04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.288580:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecfb6ec9/0xd8041b54d6dfaa04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.288589:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecfb6ec9/0xd8041b54d6dfaa04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.288597:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecfb6ec9/0xd8041b54d6dfaa04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.288626:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788845536.288687:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845536.288693:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecfb6ec9/0xd8041b54d6dfaa04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.288702:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.288706:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecfb6ec9/0xd8041b54d6dfaa04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.288715:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecfb6ec9/0xd8041b54d6dfaa04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.288727:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecfb6ec9/0xd8041b54d6dfaa04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.288735:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecfb6ec9/0xd8041b54d6dfaa04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.288755:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845536.288758:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845536.288761:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.288973:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.288981:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ac5888c/0xd8041b54d6dfaa0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.288992:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.288995:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.289000:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ac5888c/0xd8041b54d6dfaa0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.289011:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ac5888c/0xd8041b54d6dfaa0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.289019:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ac5888c/0xd8041b54d6dfaa0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.289027:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ac5888c/0xd8041b54d6dfaa0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.289046:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788845536.289280:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.289286:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b40b0a33/0xd8041b54d6dfaa12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289295:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.289298:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.289302:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b40b0a33/0xd8041b54d6dfaa12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289311:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b40b0a33/0xd8041b54d6dfaa12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289321:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b40b0a33/0xd8041b54d6dfaa12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289329:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b40b0a33/0xd8041b54d6dfaa12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289346:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788845536.289357:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845536.289380:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ac5888c/0xd8041b54d6dfaa0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289389:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.289399:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ac5888c/0xd8041b54d6dfaa0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289406:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ac5888c/0xd8041b54d6dfaa0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289419:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ac5888c/0xd8041b54d6dfaa0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289426:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ac5888c/0xd8041b54d6dfaa0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289447:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.289451:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b40b0a33/0xd8041b54d6dfaa12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289457:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ac00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.289461:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b40b0a33/0xd8041b54d6dfaa12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289469:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b40b0a33/0xd8041b54d6dfaa12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289478:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b40b0a33/0xd8041b54d6dfaa12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289486:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b40b0a33/0xd8041b54d6dfaa12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.289521:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.289524:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.289527:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845536.289846:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788845536.290314:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.290322:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079d1ee89/0xd8041b54d6dfaa19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.290335:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.290339:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.290344:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079d1ee89/0xd8041b54d6dfaa19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.290354:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079d1ee89/0xd8041b54d6dfaa19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.290384:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079d1ee89/0xd8041b54d6dfaa19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.290392:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079d1ee89/0xd8041b54d6dfaa19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.290409:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788845536.290420:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.290424:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079d1ee89/0xd8041b54d6dfaa19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.290444:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748ba00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.290448:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079d1ee89/0xd8041b54d6dfaa19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.290456:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079d1ee89/0xd8041b54d6dfaa19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.290472:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079d1ee89/0xd8041b54d6dfaa19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.290479:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079d1ee89/0xd8041b54d6dfaa19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.290508:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.290510:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.290513:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.290938:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.290949:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000136fcef5/0xd8041b54d6dfaa20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.290967:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.290971:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.290975:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000136fcef5/0xd8041b54d6dfaa20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.290987:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000136fcef5/0xd8041b54d6dfaa20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.290995:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000136fcef5/0xd8041b54d6dfaa20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.291003:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000136fcef5/0xd8041b54d6dfaa20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.291027:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788845536.291277:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.291284:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfaa27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.291293:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.291296:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845536.291299:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.291301:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfaa27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.291308:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000136fcef5/0xd8041b54d6dfaa20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.291314:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfaa27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.291320:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.291325:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000136fcef5/0xd8041b54d6dfaa20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.291334:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfaa27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.291355:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000136fcef5/0xd8041b54d6dfaa20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.291390:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfaa27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.291401:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000136fcef5/0xd8041b54d6dfaa20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.291409:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788845536.291411:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000136fcef5/0xd8041b54d6dfaa20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.291420:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845536.291442:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.291445:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.291448:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.291558:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.291566:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d5f639e/0xd8041b54d6dfaa2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.291574:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.291578:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.291582:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d5f639e/0xd8041b54d6dfaa2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.291592:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d5f639e/0xd8041b54d6dfaa2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.291611:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d5f639e/0xd8041b54d6dfaa2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.291618:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d5f639e/0xd8041b54d6dfaa2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.291632:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788845536.291935:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845536.291941:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d5f639e/0xd8041b54d6dfaa2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.291950:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81480600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845536.291953:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d5f639e/0xd8041b54d6dfaa2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.291961:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d5f639e/0xd8041b54d6dfaa2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.291974:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d5f639e/0xd8041b54d6dfaa2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.291993:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d5f639e/0xd8041b54d6dfaa2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845536.292013:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.292015:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.292017:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788845536.292887:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.292899:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c7700f1/0xd8041b54d6dfaa35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.292913:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.292917:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.292922:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c7700f1/0xd8041b54d6dfaa35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.292933:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c7700f1/0xd8041b54d6dfaa35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.292942:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c7700f1/0xd8041b54d6dfaa35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.292950:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c7700f1/0xd8041b54d6dfaa35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.292981:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788845536.292993:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.292998:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c7700f1/0xd8041b54d6dfaa35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293006:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748a600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.293009:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c7700f1/0xd8041b54d6dfaa35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293017:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c7700f1/0xd8041b54d6dfaa35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293033:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c7700f1/0xd8041b54d6dfaa35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293039:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c7700f1/0xd8041b54d6dfaa35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293054:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.293056:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.293058:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788845536.293719:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.293726:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce42ef77/0xd8041b54d6dfaa3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293737:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.293746:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.293752:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce42ef77/0xd8041b54d6dfaa3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293763:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce42ef77/0xd8041b54d6dfaa3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293771:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce42ef77/0xd8041b54d6dfaa3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293779:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce42ef77/0xd8041b54d6dfaa3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293798:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788845536.293810:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.293815:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce42ef77/0xd8041b54d6dfaa3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293824:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2175000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.293827:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce42ef77/0xd8041b54d6dfaa3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293835:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce42ef77/0xd8041b54d6dfaa3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293846:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce42ef77/0xd8041b54d6dfaa3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293866:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce42ef77/0xd8041b54d6dfaa3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.293882:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.293885:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.293886:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788845536.294669:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.294677:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f39d6ffc/0xd8041b54d6dfaa43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.294688:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.294692:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.294697:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f39d6ffc/0xd8041b54d6dfaa43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.294709:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f39d6ffc/0xd8041b54d6dfaa43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.294719:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f39d6ffc/0xd8041b54d6dfaa43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.294727:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f39d6ffc/0xd8041b54d6dfaa43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.294746:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788845536.294757:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.294767:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f39d6ffc/0xd8041b54d6dfaa43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.294775:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174e00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.294779:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f39d6ffc/0xd8041b54d6dfaa43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.294788:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f39d6ffc/0xd8041b54d6dfaa43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.294801:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f39d6ffc/0xd8041b54d6dfaa43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.294809:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f39d6ffc/0xd8041b54d6dfaa43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.294824:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.294826:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.294828:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788845536.295426:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.295433:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a4d3e17/0xd8041b54d6dfaa4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.295443:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.295447:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.295452:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a4d3e17/0xd8041b54d6dfaa4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.295472:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a4d3e17/0xd8041b54d6dfaa4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.295487:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a4d3e17/0xd8041b54d6dfaa4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.295506:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a4d3e17/0xd8041b54d6dfaa4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.295523:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788845536.295534:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.295539:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a4d3e17/0xd8041b54d6dfaa4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.295539:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.295552:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845536.295552:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6b37518/0xd8041b54d6dfaa51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.295558:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a4d3e17/0xd8041b54d6dfaa4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.295572:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.295575:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a4d3e17/0xd8041b54d6dfaa4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.295577:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.295586:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6b37518/0xd8041b54d6dfaa51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.295595:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a4d3e17/0xd8041b54d6dfaa4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.295605:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a4d3e17/0xd8041b54d6dfaa4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.295625:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.295627:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.295628:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.295868:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6b37518/0xd8041b54d6dfaa51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.295879:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6b37518/0xd8041b54d6dfaa51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.295886:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6b37518/0xd8041b54d6dfaa51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.295912:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788845536.295974:0:15885:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845536.295982:0:15885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6b37518/0xd8041b54d6dfaa51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.296000:0:15885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81480200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.296005:0:15885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6b37518/0xd8041b54d6dfaa51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.296015:0:15885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6b37518/0xd8041b54d6dfaa51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.296032:0:15885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6b37518/0xd8041b54d6dfaa51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.296040:0:15885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6b37518/0xd8041b54d6dfaa51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.296115:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788845536.296670:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788845536.296971:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.296979:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d74d963b/0xd8041b54d6dfaa58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.296991:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.296995:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.297000:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d74d963b/0xd8041b54d6dfaa58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.297011:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d74d963b/0xd8041b54d6dfaa58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.297020:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d74d963b/0xd8041b54d6dfaa58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.297027:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d74d963b/0xd8041b54d6dfaa58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.297042:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788845536.297052:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788845536.297789:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.297802:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6334897/0xd8041b54d6dfaa5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.297813:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.297816:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.297820:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6334897/0xd8041b54d6dfaa5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.297831:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6334897/0xd8041b54d6dfaa5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.297838:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6334897/0xd8041b54d6dfaa5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.297845:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6334897/0xd8041b54d6dfaa5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.297852:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788845536.298406:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.298415:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5b55982/0xd8041b54d6dfaa66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.298425:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.298429:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.298433:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5b55982/0xd8041b54d6dfaa66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.298443:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5b55982/0xd8041b54d6dfaa66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.298458:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5b55982/0xd8041b54d6dfaa66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.298464:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5b55982/0xd8041b54d6dfaa66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.298472:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788845536.298847:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.298853:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf5d360/0xd8041b54d6dfaa6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.298862:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.298865:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.298870:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bf5d360/0xd8041b54d6dfaa6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.298879:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bf5d360/0xd8041b54d6dfaa6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.298888:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf5d360/0xd8041b54d6dfaa6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.298895:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bf5d360/0xd8041b54d6dfaa6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.298914:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788845536.299451:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.299458:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000699530be/0xd8041b54d6dfaa74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.299468:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.299471:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.299475:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000699530be/0xd8041b54d6dfaa74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.299486:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000699530be/0xd8041b54d6dfaa74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.299504:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000699530be/0xd8041b54d6dfaa74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.299513:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000699530be/0xd8041b54d6dfaa74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.299521:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788845536.299919:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.299926:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000903f5b80/0xd8041b54d6dfaa7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.299935:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.299943:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.299947:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000903f5b80/0xd8041b54d6dfaa7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.299957:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000903f5b80/0xd8041b54d6dfaa7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.299965:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000903f5b80/0xd8041b54d6dfaa7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.299972:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000903f5b80/0xd8041b54d6dfaa7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.299980:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788845536.300820:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.300828:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01fc9b6/0xd8041b54d6dfaa82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.300839:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.300843:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.300847:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b01fc9b6/0xd8041b54d6dfaa82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.300857:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b01fc9b6/0xd8041b54d6dfaa82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.300866:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01fc9b6/0xd8041b54d6dfaa82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.300880:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b01fc9b6/0xd8041b54d6dfaa82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.300888:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788845536.301445:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.301452:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000769f5153/0xd8041b54d6dfaa89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.301461:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.301464:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.301468:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000769f5153/0xd8041b54d6dfaa89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.301478:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000769f5153/0xd8041b54d6dfaa89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.301486:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000769f5153/0xd8041b54d6dfaa89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.301506:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000769f5153/0xd8041b54d6dfaa89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.301516:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788845536.301926:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.301932:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d3b13c/0xd8041b54d6dfaa90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.301946:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.301949:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.301953:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d3b13c/0xd8041b54d6dfaa90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.301962:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9d3b13c/0xd8041b54d6dfaa90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.301971:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d3b13c/0xd8041b54d6dfaa90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.301979:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d3b13c/0xd8041b54d6dfaa90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.301988:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1788845536.302509:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfaa27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.302522:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.302528:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfaa27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.302538:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfaa27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.302557:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfaa27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845536.302568:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.302579:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000203135a6/0xd8041b54d6dfaa97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.302583:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002491e0a0/0xd8041b54d6dfaa27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.302595:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.302600:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.302605:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000203135a6/0xd8041b54d6dfaa97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.302615:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000203135a6/0xd8041b54d6dfaa97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.302615:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788845536.302623:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6334897/0xd8041b54d6dfaa5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.302643:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000203135a6/0xd8041b54d6dfaa97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.302651:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000203135a6/0xd8041b54d6dfaa97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.302659:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788845536.303061:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.303067:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007106a0bd/0xd8041b54d6dfaa9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.303077:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.303081:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.303085:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007106a0bd/0xd8041b54d6dfaa9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.303095:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007106a0bd/0xd8041b54d6dfaa9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.303103:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007106a0bd/0xd8041b54d6dfaa9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.303110:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007106a0bd/0xd8041b54d6dfaa9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.303130:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788845536.303704:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.303711:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094cadc00/0xd8041b54d6dfaaa5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.303722:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.303725:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.303729:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094cadc00/0xd8041b54d6dfaaa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.303737:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094cadc00/0xd8041b54d6dfaaa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.303745:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094cadc00/0xd8041b54d6dfaaa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.303753:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094cadc00/0xd8041b54d6dfaaa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303774:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.303776:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:0.0:1788845536.303781:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6334897/0xd8041b54d6dfaa5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303793:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6334897/0xd8041b54d6dfaa5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303810:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6334897/0xd8041b54d6dfaa5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303818:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6334897/0xd8041b54d6dfaa5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303842:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788845536.303847:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5b55982/0xd8041b54d6dfaa66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303854:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.303865:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5b55982/0xd8041b54d6dfaa66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303873:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5b55982/0xd8041b54d6dfaa66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303886:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5b55982/0xd8041b54d6dfaa66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303894:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5b55982/0xd8041b54d6dfaa66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303911:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788845536.303915:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bf5d360/0xd8041b54d6dfaa6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303923:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2175c00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.303927:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf5d360/0xd8041b54d6dfaa6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303935:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf5d360/0xd8041b54d6dfaa6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303946:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bf5d360/0xd8041b54d6dfaa6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303955:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bf5d360/0xd8041b54d6dfaa6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303985:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788845536.303989:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000699530be/0xd8041b54d6dfaa74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.303997:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174a00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.304001:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000699530be/0xd8041b54d6dfaa74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304010:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000699530be/0xd8041b54d6dfaa74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304022:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000699530be/0xd8041b54d6dfaa74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304030:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000699530be/0xd8041b54d6dfaa74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304043:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788845536.304046:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000903f5b80/0xd8041b54d6dfaa7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304052:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422b800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.304055:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000903f5b80/0xd8041b54d6dfaa7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304075:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000903f5b80/0xd8041b54d6dfaa7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304088:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000903f5b80/0xd8041b54d6dfaa7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304096:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000903f5b80/0xd8041b54d6dfaa7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304116:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788845536.304120:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b01fc9b6/0xd8041b54d6dfaa82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304128:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422a400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.304132:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01fc9b6/0xd8041b54d6dfaa82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304140:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01fc9b6/0xd8041b54d6dfaa82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304152:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b01fc9b6/0xd8041b54d6dfaa82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304159:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b01fc9b6/0xd8041b54d6dfaa82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304255:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788845536.304259:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000769f5153/0xd8041b54d6dfaa89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304266:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422ae00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.304270:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000769f5153/0xd8041b54d6dfaa89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304278:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000769f5153/0xd8041b54d6dfaa89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304379:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000769f5153/0xd8041b54d6dfaa89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304388:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000769f5153/0xd8041b54d6dfaa89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304407:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788845536.304411:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9d3b13c/0xd8041b54d6dfaa90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304418:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422bc00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.304421:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d3b13c/0xd8041b54d6dfaa90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845536.304434:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.304444:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000658f9469/0xd8041b54d6dfaaac lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304447:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d3b13c/0xd8041b54d6dfaa90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.304465:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788845536.304471:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9d3b13c/0xd8041b54d6dfaa90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.304478:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845536.304486:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9d3b13c/0xd8041b54d6dfaa90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.304489:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000658f9469/0xd8041b54d6dfaaac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.304521:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000658f9469/0xd8041b54d6dfaaac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.304530:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000658f9469/0xd8041b54d6dfaaac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304530:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788845536.304537:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000203135a6/0xd8041b54d6dfaa97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.304543:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000658f9469/0xd8041b54d6dfaaac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304551:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422a200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.304557:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000203135a6/0xd8041b54d6dfaa97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.304560:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788845536.304571:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000203135a6/0xd8041b54d6dfaa97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.304585:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000203135a6/0xd8041b54d6dfaa97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.304593:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788845536.304593:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000203135a6/0xd8041b54d6dfaa97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.304607:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008889463b/0xd8041b54d6dfaab3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.304628:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.304632:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.304639:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008889463b/0xd8041b54d6dfaab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.304650:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008889463b/0xd8041b54d6dfaab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.304658:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008889463b/0xd8041b54d6dfaab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.304665:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008889463b/0xd8041b54d6dfaab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.304673:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788845536.305084:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.305091:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000151b1e97/0xd8041b54d6dfaaba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.305100:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.305103:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.305108:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000151b1e97/0xd8041b54d6dfaaba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.305118:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000151b1e97/0xd8041b54d6dfaaba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.305125:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000151b1e97/0xd8041b54d6dfaaba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.305139:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000151b1e97/0xd8041b54d6dfaaba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.305149:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788845536.305452:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788845536.305458:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007106a0bd/0xd8041b54d6dfaa9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.305467:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422a600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.305471:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007106a0bd/0xd8041b54d6dfaa9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.305480:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007106a0bd/0xd8041b54d6dfaa9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.305507:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007106a0bd/0xd8041b54d6dfaa9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.305515:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007106a0bd/0xd8041b54d6dfaa9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.305533:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788845536.305537:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094cadc00/0xd8041b54d6dfaaa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.305544:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422aa00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.305549:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094cadc00/0xd8041b54d6dfaaa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.305551:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.305563:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0840f2/0xd8041b54d6dfaac1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.305584:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788845536.305587:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094cadc00/0xd8041b54d6dfaaa5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.305599:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.305606:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0840f2/0xd8041b54d6dfaac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.305608:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094cadc00/0xd8041b54d6dfaaa5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.305626:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce0840f2/0xd8041b54d6dfaac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.305641:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0840f2/0xd8041b54d6dfaac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.305648:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0840f2/0xd8041b54d6dfaac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.305657:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788845536.305826:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.305833:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c6d2ebe/0xd8041b54d6dfaac8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.305842:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.305845:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.305849:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c6d2ebe/0xd8041b54d6dfaac8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.305858:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c6d2ebe/0xd8041b54d6dfaac8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.305866:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c6d2ebe/0xd8041b54d6dfaac8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.305874:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c6d2ebe/0xd8041b54d6dfaac8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.305884:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788845536.306241:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094cadc00/0xd8041b54d6dfaaa5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306264:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788845536.306433:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000658f9469/0xd8041b54d6dfaaac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306443:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422ac00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.306448:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000658f9469/0xd8041b54d6dfaaac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306458:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000658f9469/0xd8041b54d6dfaaac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306472:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000658f9469/0xd8041b54d6dfaaac lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306480:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000658f9469/0xd8041b54d6dfaaac lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306519:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788845536.306524:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008889463b/0xd8041b54d6dfaab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306531:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481c00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.306534:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008889463b/0xd8041b54d6dfaab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306543:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008889463b/0xd8041b54d6dfaab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306558:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008889463b/0xd8041b54d6dfaab3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306566:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008889463b/0xd8041b54d6dfaab3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306590:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788845536.306595:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000151b1e97/0xd8041b54d6dfaaba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845536.306603:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788845536.306603:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422b000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.306609:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000151b1e97/0xd8041b54d6dfaaba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.306613:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000420ecfa4/0xd8041b54d6dfaacf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.306636:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.306641:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.306646:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000420ecfa4/0xd8041b54d6dfaacf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.306657:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000420ecfa4/0xd8041b54d6dfaacf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.306664:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000420ecfa4/0xd8041b54d6dfaacf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.306672:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000420ecfa4/0xd8041b54d6dfaacf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.306680:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788845536.306979:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000151b1e97/0xd8041b54d6dfaaba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.306994:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000151b1e97/0xd8041b54d6dfaaba lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.307001:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000151b1e97/0xd8041b54d6dfaaba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.307019:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788845536.307022:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce0840f2/0xd8041b54d6dfaac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.307029:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81481200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.307033:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0840f2/0xd8041b54d6dfaac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.307040:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0840f2/0xd8041b54d6dfaac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.307050:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce0840f2/0xd8041b54d6dfaac1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.307057:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce0840f2/0xd8041b54d6dfaac1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845536.307081:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788845536.307085:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845536.307088:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003dda441/0xd8041b54d6dfaad6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.307091:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c6d2ebe/0xd8041b54d6dfaac8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.307107:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788845536.307108:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422a000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.307113:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845536.307115:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c6d2ebe/0xd8041b54d6dfaac8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.307119:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003dda441/0xd8041b54d6dfaad6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.307129:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c6d2ebe/0xd8041b54d6dfaac8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.307135:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003dda441/0xd8041b54d6dfaad6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.307143:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c6d2ebe/0xd8041b54d6dfaac8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.307158:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c6d2ebe/0xd8041b54d6dfaac8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.307172:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.307290:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003dda441/0xd8041b54d6dfaad6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.307298:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003dda441/0xd8041b54d6dfaad6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.307306:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788845536.307742:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845536.307749:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfaadd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.307759:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.307762:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845536.307766:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfaadd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.307776:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfaadd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.307783:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfaadd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.307790:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfaadd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.307809:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1788845536.308011:0:15054:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788845536.308116:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14398:x1875740189614080:12345-0@lo:5:osp-pre-1-0.0 Request processed in 63524us (64538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845536.308127:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788845536.308569:0:15886:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845536.308575:0:15886:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003dda441/0xd8041b54d6dfaad6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308585:0:15886:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422be00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.308589:0:15886:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003dda441/0xd8041b54d6dfaad6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308599:0:15886:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003dda441/0xd8041b54d6dfaad6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308615:0:15886:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003dda441/0xd8041b54d6dfaad6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308623:0:15886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003dda441/0xd8041b54d6dfaad6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308650:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d74d963b/0xd8041b54d6dfaa58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308670:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aec2174000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.308674:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d74d963b/0xd8041b54d6dfaa58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308684:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d74d963b/0xd8041b54d6dfaa58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845536.308684:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.308696:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064fa18c9/0xd8041b54d6dfaae4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308701:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d74d963b/0xd8041b54d6dfaa58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.308714:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788845536.308716:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d74d963b/0xd8041b54d6dfaa58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.308732:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845536.308733:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000420ecfa4/0xd8041b54d6dfaacf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308737:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845536.308742:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064fa18c9/0xd8041b54d6dfaae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308745:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfaadd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.308750:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422a800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845536.308756:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000420ecfa4/0xd8041b54d6dfaacf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308758:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422b600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.308765:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfaadd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308780:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfaadd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.308788:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000420ecfa4/0xd8041b54d6dfaacf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308794:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfaadd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.308805:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000420ecfa4/0xd8041b54d6dfaacf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308817:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfaadd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845536.308830:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000420ecfa4/0xd8041b54d6dfaacf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.308835:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064fa18c9/0xd8041b54d6dfaae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308841:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.308846:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.308850:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.308851:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064fa18c9/0xd8041b54d6dfaae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308857:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.308860:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.308864:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845536.308869:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064fa18c9/0xd8041b54d6dfaae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.308884:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788845536.308894:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.308900:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064fa18c9/0xd8041b54d6dfaae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308908:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae81480400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.308912:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064fa18c9/0xd8041b54d6dfaae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308919:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064fa18c9/0xd8041b54d6dfaae4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308932:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064fa18c9/0xd8041b54d6dfaae4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308941:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064fa18c9/0xd8041b54d6dfaae4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.308971:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.308975:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.308977:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845536.309673:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14398:1875740189614080:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788845536.309690:0:14398:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788845536.309745:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc683480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14398:1875740189614208:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788845536.309802:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845536.309841:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98f50c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845536.309862:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189614208 00000100:00100000:3.0:1788845536.309867:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189614208 00000100:00100000:3.0:1788845536.309907:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845536.309916:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14398:x1875740189614208:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788845536.309954:0:15055:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00002000:00010000:2.0:1788845536.309994:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.310002:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005496bd54/0xd8041b54d6dfaaeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.310014:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.310018:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.310022:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005496bd54/0xd8041b54d6dfaaeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.310031:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005496bd54/0xd8041b54d6dfaaeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.310041:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005496bd54/0xd8041b54d6dfaaeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.310051:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005496bd54/0xd8041b54d6dfaaeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.310066:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788845536.311033:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.311042:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df01e38a/0xd8041b54d6dfaaf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.311060:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.311063:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.311068:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df01e38a/0xd8041b54d6dfaaf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.311079:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df01e38a/0xd8041b54d6dfaaf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.311088:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df01e38a/0xd8041b54d6dfaaf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.311096:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df01e38a/0xd8041b54d6dfaaf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.311111:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788845536.311977:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845536.311988:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005496bd54/0xd8041b54d6dfaaeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.311999:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeaeeb9200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.312004:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005496bd54/0xd8041b54d6dfaaeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.312013:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005496bd54/0xd8041b54d6dfaaeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.312046:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005496bd54/0xd8041b54d6dfaaeb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.312053:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005496bd54/0xd8041b54d6dfaaeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.312073:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.312076:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df01e38a/0xd8041b54d6dfaaf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.312083:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeaeeb9800 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.312086:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df01e38a/0xd8041b54d6dfaaf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.312093:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df01e38a/0xd8041b54d6dfaaf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.312102:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df01e38a/0xd8041b54d6dfaaf2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.312109:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df01e38a/0xd8041b54d6dfaaf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.312125:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.312127:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.312134:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788845536.313017:0:15883:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845536.313027:0:15883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97c4d89/0xd8041b54d6dfaaf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.313040:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788845536.313043:0:15883:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845536.313049:0:15883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f97c4d89/0xd8041b54d6dfaaf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.313060:0:15883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f97c4d89/0xd8041b54d6dfaaf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.313079:0:15883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97c4d89/0xd8041b54d6dfaaf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.313087:0:15883:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f97c4d89/0xd8041b54d6dfaaf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845536.313105:0:15883:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788845536.313389:0:15883:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:3.0:1788845536.314068:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845536.314076:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f97c4d89/0xd8041b54d6dfaaf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.314088:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeaeeb8400 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845536.314093:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97c4d89/0xd8041b54d6dfaaf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.314103:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97c4d89/0xd8041b54d6dfaaf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.314120:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f97c4d89/0xd8041b54d6dfaaf9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.314127:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f97c4d89/0xd8041b54d6dfaaf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845536.314148:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.314150:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845536.314152:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845536.314575:0:15883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14396:x1875740189613824:12345-0@lo:5:osp-pre-0-0.0 Request processed in 77046us (81354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845536.314590:0:15883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788845536.314623:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845536.314662:0:14396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14396:1875740189613824:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788845536.314678:0:14396:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00010000:00010000:0.0:1788845536.314847:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845536.314851:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845536.314853:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845536.314971:0:14396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14396:1875740189614336:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788845536.315013:0:14396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845536.315055:0:14396:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98f50900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845536.315259:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189614336 00000100:00100000:2.0:1788845536.315266:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189614336 00000100:00100000:2.0:1788845536.315304:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788845536.315313:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14396:x1875740189614336:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788845536.315353:0:15054:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1788845536.321515:0:15885:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.321521:0:15885:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845536.321523:0:15885:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845536.322556:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14398:x1875740189614208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12632us (12745us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788845536.322570:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845536.322635:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc683480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14398:1875740189614208:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788845536.322652:0:14398:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788845536.335250:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14396:x1875740189614336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19926us (20224us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788845536.335265:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845536.335560:0:14396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14396:1875740189614336:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788845536.335576:0:14396:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:1.0:1788845536.383683:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788845537.307468:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788845537.428346:0:6682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788845537.428414:0:6682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1788845538.334418:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845539.356217:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788845539.550501:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788845539.550528:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:02000400:3.0:1788845540.076237:0:16130:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788845540.380608:0:15885:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845541.403501:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845541.467598:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189614848:0@lo:400:kworker.0 00000100:00100000:3.0:1788845541.467681:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845541.467958:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d9107f4-aa08-4701-832e-746d9df521c4:3286:1875740189614464:0@lo:400:kworker.0 00000100:00100000:1.0:1788845541.467994:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845541.471719:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189614720:0@lo:400:kworker.0 00000100:00100000:3.0:1788845541.471798:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845541.471862:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189615232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845541.471892:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845541.471922:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788845541.471927:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189614592:0@lo:400:kworker.0 00000100:00100000:3.0:1788845541.471944:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845541.471965:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189615104:0@lo:400:kworker.0 00000100:00100000:3.0:1788845541.471985:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845541.472029:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189614848 00000100:00100000:3.0:1788845541.472037:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189614848 00000100:00100000:3.0:1788845541.472085:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189615104 00000100:00100000:3.0:1788845541.472087:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189615104 00000100:00100000:3.0:1788845541.472108:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788845541.472131:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189614848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845541.472183:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875740189614848:12345-0@lo:400:kworker.0 Request processed in 53us (4502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845541.472190:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788845541.472218:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788845541.472225:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189615104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845541.472256:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875740189615104:12345-0@lo:400:kworker.0 Request processed in 32us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845541.472262:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788845541.472325:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189614720 00000100:00100000:3.0:1788845541.472328:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189614720 00000100:00100000:3.0:1788845541.472352:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189614592 00000100:00100000:3.0:1788845541.472355:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189614592 00000100:00100000:3.0:1788845541.472405:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845541.472412:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189614720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845541.472442:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189614720:12345-0@lo:400:kworker.0 Request processed in 31us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845541.472449:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845541.472459:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845541.472477:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189614592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845541.472504:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189614592:12345-0@lo:400:kworker.0 Request processed in 39us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845541.472509:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845541.472531:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189615232 00000100:00100000:3.0:1788845541.472535:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189615232 00000100:00100000:3.0:1788845541.472557:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845541.472563:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189615232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788845541.472598:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845541.472644:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189615232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845541.472651:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788845541.472674:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845541.472678:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845541.472681:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845541.472699:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189615360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845541.472725:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788845541.472756:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc682a00 x1875740189614848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845541.472771:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875740189614848:0@lo:400:kworker.0 00000100:00100000:3.0:1788845541.472800:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189615360 00000100:00100000:3.0:1788845541.472803:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189615360 00000100:00100000:3.0:1788845541.472821:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845541.472826:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189615360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845541.472843:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845541.472871:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189615360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845541.472877:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845541.472897:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788845541.472911:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189615360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845541.472929:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788845541.472936:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189614592:0@lo:400:kworker.0 00010000:00080000:3.0:1788845541.472947:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc681500 x1875740189615104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845541.472963:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875740189615104:0@lo:400:kworker.0 00000100:00100000:3.0:1788845541.472974:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189614720:0@lo:400:kworker.0 00000100:00100000:3.0:1788845541.472986:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189615232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845541.476161:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189614976:0@lo:400:kworker.0 00000100:00100000:0.0:1788845541.476309:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189614464 00000100:00100000:0.0:1788845541.476317:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189614464 00000100:00100000:0.0:1788845541.476376:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788845541.476385:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+19:3286:x1875740189614464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845541.476460:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+19:3286:x1875740189614464:12345-0@lo:400:kworker.0 Request processed in 77us (8465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845541.476479:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788845541.477397:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845541.477438:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189614976 00000100:00100000:1.0:1788845541.477445:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189614976 00000100:00100000:1.0:1788845541.477508:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788845541.477516:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189614976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845541.477560:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875740189614976:12345-0@lo:400:kworker.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845541.477567:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788845541.478537:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788845541.479835:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92aebc681f80 x1875740189614976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845541.479957:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875740189614976:0@lo:400:kworker.0 00000100:00100000:1.0:1788845541.480015:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d9107f4-aa08-4701-832e-746d9df521c4:3286:1875740189614464:0@lo:400:kworker.0 00000100:00100000:2.0:1788845542.388624:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845542.388766:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180190208 00000100:00100000:0.0:1788845542.388777:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180190208 00000100:00100000:0.0:1788845542.388847:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:0.0:1788845542.388857:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2371:x1875740180190208:12345-192.168.206.35@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788845542.388913:0:14368:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a@192.168.206.35@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:0.0:1788845542.388956:0:14368:0:(genops.c:1385:class_connect()) connect: client 9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a, cookie 0xd8041b54d6dfab00 00000100:00080000:0.0:1788845542.389224:0:14368:0:(import.c:65:import_set_state_nolock()) ffff92aeb79c8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845542.389540:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+5:2371:x1875740180190208:12345-192.168.206.35@tcp:250:mount.lustre.0 Request processed in 681us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845542.389548:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:0.0:1788845542.401056:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845542.402759:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180190336 00000100:00100000:2.0:1788845542.402777:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180190336 00000100:00100000:2.0:1788845542.402839:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 75 00000100:00100000:2.0:1788845542.402850:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+5:13754:x1875740180190336:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788845542.403016:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845542.403035:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeaeeb8200/0xd8041b54d6dfab07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce120077526d4 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845542.403071:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeaeeb8200/0xd8041b54d6dfab07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526d4 expref: 6 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845542.403082:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeaeeb8200/0xd8041b54d6dfab07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526d4 expref: 6 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845542.403091:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb8200, rc 0) 00000100:00100000:2.0:1788845542.403171:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+6:13754:x1875740180190336:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 313us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845542.403180:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 75 00000100:00100000:0.0:1788845542.406082:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845542.406233:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180190464 00000100:00100000:2.0:1788845542.406243:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180190464 00000100:00100000:0.0:1788845542.406805:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:0.0:1788845542.406821:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+6:13754:x1875740180190464:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788845542.408089:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+6:13754:x1875740180190464:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 1264us (2012us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788845542.408100:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:3.0:1788845542.412221:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845542.412625:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180190592 00000100:00100000:2.0:1788845542.412636:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180190592 00000100:00100000:2.0:1788845542.412701:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 77 00000100:00100000:2.0:1788845542.412713:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+6:13754:x1875740180190592:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788845542.412731:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845542.412750:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeaeeb9c00/0xd8041b54d6dfab0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce120077526db expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845542.412779:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeaeeb9c00/0xd8041b54d6dfab0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526db expref: 7 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845542.412791:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeaeeb9c00/0xd8041b54d6dfab0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077526db expref: 7 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845542.412819:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb9c00, rc 0) 00000100:00100000:2.0:1788845542.413081:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+7:13754:x1875740180190592:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 369us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845542.413088:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 77 00000100:00100000:1.0:1788845542.420163:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845542.420310:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180190720 00000100:00100000:2.0:1788845542.420322:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180190720 00000100:00100000:0.0:1788845542.421091:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:0.0:1788845542.421106:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+7:13754:x1875740180190720:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788845542.421497:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+8:13754:x1875740180190720:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 394us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845542.421514:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:1.0:1788845542.426794:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845542.427080:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180190848 00000100:00100000:0.0:1788845542.427091:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180190848 00000100:00100000:0.0:1788845542.427161:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:0.0:1788845542.427172:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+8:13754:x1875740180190848:12345-192.168.206.35@tcp:503:mount.lustre.0 00010000:00010000:2.0:1788845542.427911:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845542.429255:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+8:13754:x1875740180190848:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 2063us (2463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845542.429269:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:3.0:1788845542.436002:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845542.436755:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180190976 00000100:00100000:1.0:1788845542.436768:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180190976 00000100:00100000:1.0:1788845542.436838:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 80 00000100:00100000:1.0:1788845542.436848:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+8:13773:x1875740180190976:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845542.438602:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+8:13773:x1875740180190976:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 1742us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845542.438616:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 80 00000100:00100000:2.0:1788845542.457726:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845542.457917:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180191104 00000100:00100000:1.0:1788845542.457928:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180191104 00000100:00100000:1.0:1788845542.458081:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 81 00000100:00100000:1.0:1788845542.458093:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+8:13773:x1875740180191104:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845542.458774:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+8:13773:x1875740180191104:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 679us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845542.458796:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 81 00000100:00100000:0.0:1788845542.463900:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845542.464125:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180191232 00000100:00100000:1.0:1788845542.464135:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180191232 00000100:00100000:1.0:1788845542.464198:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 82 00000100:00100000:1.0:1788845542.464217:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+8:13754:x1875740180191232:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788845542.464233:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845542.464250:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc09400/0xd8041b54d6dfab15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce12007752705 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845542.464278:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc09400/0xd8041b54d6dfab15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752705 expref: 9 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845542.464290:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc09400/0xd8041b54d6dfab15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752705 expref: 9 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845542.464298:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09400, rc 0) 00000100:00100000:1.0:1788845542.464705:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+9:13754:x1875740180191232:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 155us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845542.464714:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 82 00000100:00100000:3.0:1788845542.473331:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845542.473597:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180191360 00000100:00100000:1.0:1788845542.473607:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180191360 00000100:00100000:1.0:1788845542.473669:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:1.0:1788845542.473681:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+9:13754:x1875740180191360:12345-192.168.206.35@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788845542.473707:0:14368:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788845542.473736:0:14368:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788845542.473740:0:14368:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788845542.473742:0:14368:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788845542.473749:0:14368:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788845542.476054:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+9:13754:x1875740180191360:12345-192.168.206.35@tcp:256:mount.lustre.0 Request processed in 2363us (2722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845542.476263:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:0.0:1788845542.479709:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845542.480091:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180191488 00000100:00100000:1.0:1788845542.480102:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180191488 00000100:00100000:1.0:1788845542.480225:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:1.0:1788845542.480236:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+9:13754:x1875740180191488:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788845542.480254:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845542.480271:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfab1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce1200775270c expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845542.480300:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfab1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775270c expref: 10 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845542.480312:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfab1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775270c expref: 10 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845542.480321:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08c00, rc 0) 00000100:00100000:1.0:1788845542.480433:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+10:13754:x1875740180191488:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 198us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845542.480441:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:3.0:1788845542.484556:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845542.484804:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180191616 00000100:00100000:1.0:1788845542.484814:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180191616 00000100:00100000:1.0:1788845542.484985:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 85 00000100:00100000:1.0:1788845542.484996:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+10:13754:x1875740180191616:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788845542.485482:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+10:13754:x1875740180191616:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 487us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845542.485502:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 85 00000100:00100000:0.0:1788845542.490934:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845542.491103:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180191744 00000100:00100000:1.0:1788845542.491113:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180191744 00000100:00100000:1.0:1788845542.492876:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 86 00000100:00100000:1.0:1788845542.492889:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+10:13754:x1875740180191744:12345-192.168.206.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788845542.493849:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+10:13754:x1875740180191744:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 956us (2922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845542.493859:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 86 00000100:00100000:0.0:1788845542.497247:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845542.497834:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180191872 00000100:00100000:1.0:1788845542.497844:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180191872 00000100:00100000:1.0:1788845542.497904:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:1.0:1788845542.497915:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+10:13776:x1875740180191872:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845542.498591:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+10:13776:x1875740180191872:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 673us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845542.498601:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:3.0:1788845542.501337:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845542.502224:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180192000 00000100:00100000:1.0:1788845542.502246:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180192000 00000100:00100000:1.0:1788845542.502357:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:1.0:1788845542.502402:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+10:13776:x1875740180192000:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845542.502698:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+10:13776:x1875740180192000:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 299us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845542.502706:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:3.0:1788845542.514873:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845542.515106:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180192128 00000100:00100000:0.0:1788845542.515138:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180192128 00000100:00100000:0.0:1788845542.515194:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:0.0:1788845542.515203:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2371:x1875740180192128:12345-192.168.206.35@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788845542.515232:0:14374:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3582157f-7d60-4d28-a42b-ea8dc01a2de4@192.168.206.35@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:0.0:1788845542.515282:0:14374:0:(genops.c:1385:class_connect()) connect: client 3582157f-7d60-4d28-a42b-ea8dc01a2de4, cookie 0xd8041b54d6dfab23 00000004:00100000:0.0:1788845542.515310:0:14374:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788845542.515315:0:14374:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788845542.609981:0:14374:0:(import.c:65:import_set_state_nolock()) ffff92ae90d33000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845542.610119:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:2371:x1875740180192128:12345-192.168.206.35@tcp:38:mount.lustre.0 Request processed in 94913us (95255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845542.610140:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:3.0:1788845542.613616:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845542.613787:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845542.618357:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180192256 00000100:00100000:1.0:1788845542.618394:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180192256 00000100:00080000:3.0:1788845542.618528:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845542.618613:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180192384 00000100:00100000:2.0:1788845542.618619:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180192384 00000100:00100000:2.0:1788845542.618942:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:2.0:1788845542.618953:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:0:x1875740180192256:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788845542.618993:0:14375:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788845542.619195:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:0:x1875740180192256:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 243us (5592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845542.619202:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:2.0:1788845542.619220:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:2.0:1788845542.619226:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:13754:x1875740180192384:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788845542.619238:0:14375:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788845542.619259:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:13754:x1875740180192384:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 34us (5474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845542.619275:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:3.0:1788845542.621077:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845542.621163:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180192512 00000100:00100000:1.0:1788845542.621172:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180192512 00000100:00100000:1.0:1788845542.621219:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:1.0:1788845542.621227:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:13754:x1875740180192512:12345-192.168.206.35@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788845542.621293:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:13754:x1875740180192512:12345-192.168.206.35@tcp:40:mount.lustre.0 Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845542.621301:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:2.0:1788845542.628496:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845542.628538:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845542.628571:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845542.628701:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180192640 00000100:00100000:3.0:1788845542.628711:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180192640 00000100:00100000:3.0:1788845542.628752:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180192768 00000100:00100000:3.0:1788845542.628755:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180192768 00000100:00100000:3.0:1788845542.628888:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:3.0:1788845542.628898:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875740180192640:12345-192.168.206.35@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788845542.628930:0:15056:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3582157f-7d60-4d28-a42b-ea8dc01a2de4@192.168.206.35@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:3.0:1788845542.628969:0:15056:0:(genops.c:1385:class_connect()) connect: client 3582157f-7d60-4d28-a42b-ea8dc01a2de4, cookie 0xd8041b54d6dfab2a 00002000:00100000:3.0:1788845542.628981:0:15056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3582157f-7d60-4d28-a42b-ea8dc01a2de4/ffff92aebca07800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1788845542.628981:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180192896 00000100:00100000:0.0:1788845542.628985:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180192896 00002000:00100000:3.0:1788845542.628992:0:15056:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788845542.629016:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:0.0:1788845542.629022:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:13754:x1875740180192896:12345-192.168.206.35@tcp:33:mount.lustre.0 00002000:00080000:3.0:1788845542.629425:0:15056:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788845542.629453:0:15056:0:(import.c:65:import_set_state_nolock()) ffff92aebca01000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845542.629525:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:2371:x1875740180192640:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 628us (986us total) trans 0 rc 0/0 00000004:00080000:0.0:1788845542.629697:0:14376:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 619us 00000100:00100000:2.0:1788845542.631228:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:2.0:1788845542.631316:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875740180192768:12345-192.168.206.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788845542.631351:0:15054:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3582157f-7d60-4d28-a42b-ea8dc01a2de4@192.168.206.35@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:2.0:1788845542.631403:0:15054:0:(genops.c:1385:class_connect()) connect: client 3582157f-7d60-4d28-a42b-ea8dc01a2de4, cookie 0xd8041b54d6dfab31 00002000:00100000:2.0:1788845542.631416:0:15054:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3582157f-7d60-4d28-a42b-ea8dc01a2de4/ffff92ae90d36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788845542.631428:0:15054:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788845542.631917:0:15054:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788845542.631969:0:15054:0:(import.c:65:import_set_state_nolock()) ffff92ae90d35000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845542.632027:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:2371:x1875740180192768:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 714us (3454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845542.632035:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:3.0:1788845542.638871:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000004:00200000:2.0:1788845542.661491:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788845542.661606:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:13754:x1875740180192896:12345-192.168.206.35@tcp:33:mount.lustre.0 Request processed in 32577us (33115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845542.661623:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:2.0:1788845542.835565:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845542.835718:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180193024 00000100:00100000:0.0:1788845542.835728:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180193024 00000100:00100000:0.0:1788845542.835798:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:0.0:1788845542.835810:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:13797:x1875740180193024:12345-192.168.206.35@tcp:101:mkdir.0 00010000:00010000:0.0:1788845542.835830:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845542.835857:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fa00/0xd8041b54d6dfab38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752736 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845542.835927:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1e200/0xd8041b54d6dfab3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845542.835939:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1e200/0xd8041b54d6dfab3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845542.835951:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1e200/0xd8041b54d6dfab3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845542.836009:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788845542.836013:0:14374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845542.836051:0:14374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1e200/0xd8041b54d6dfab3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845542.836078:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fa00/0xd8041b54d6dfab38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752736 expref: 8 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845542.836103:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1e200/0xd8041b54d6dfab3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752736 expref: 7 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845542.836112:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:0.0:1788845542.836115:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845542.836119:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1e200, rc 0) 00000100:00100000:0.0:1788845542.836315:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:13797:x1875740180193024:12345-192.168.206.35@tcp:101:mkdir.0 Request processed in 507us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845542.836323:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00010000:00010000:1.0:1788845543.451693:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845544.475907:0:15885:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788845544.606618:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3582157f-7d60-4d28-a42b-ea8dc01a2de4 00000100:00100000:3.0:1788845544.697927:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.698032:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180193152 00000100:00100000:2.0:1788845544.698042:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180193152 00000100:00100000:2.0:1788845544.698183:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:2.0:1788845544.698195:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:13850:x1875740180193152:12345-192.168.206.35@tcp:41:lfs.0 00000004:00000024:2.0:1788845544.698267:0:14375:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788845544.699649:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:13850:x1875740180193152:12345-192.168.206.35@tcp:41:lfs.0 Request processed in 1447us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845544.699665:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00080000:3.0:1788845544.699804:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845544.701891:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845544.701977:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180193280 00000100:00100000:0.0:1788845544.701988:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180193280 00000100:00100000:0.0:1788845544.702110:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:0.0:1788845544.702120:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:13850:x1875740180193280:12345-192.168.206.35@tcp:13:lfs.0 00002000:00000024:0.0:1788845544.702156:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845544.702237:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:13850:x1875740180193280:12345-192.168.206.35@tcp:13:lfs.0 Request processed in 119us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845544.702244:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00080000:3.0:1788845544.706608:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845544.706913:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845544.707054:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180193408 00000100:00100000:3.0:1788845544.707065:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180193408 00000100:00100000:3.0:1788845544.707142:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:3.0:1788845544.707154:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3582157f-7d60-4d28-a42b-ea8dc01a2de4+5:13850:x1875740180193408:12345-192.168.206.35@tcp:13:lfs.0 00002000:00000024:3.0:1788845544.707190:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845544.707268:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3582157f-7d60-4d28-a42b-ea8dc01a2de4+5:13850:x1875740180193408:12345-192.168.206.35@tcp:13:lfs.0 Request processed in 117us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845544.707276:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00080000:0.0:1788845544.707903:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788845544.733197:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788845544.886807:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845544.886960:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180193536 00000100:00100000:1.0:1788845544.886969:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180193536 00000100:00100000:1.0:1788845544.887031:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 89 00000100:00100000:1.0:1788845544.887042:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+10:13882:x1875740180193536:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788845544.887057:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845544.887073:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc08800/0xd8041b54d6dfab46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce1200775273d expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845544.887103:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc08800/0xd8041b54d6dfab46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775273d expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845544.887114:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc08800/0xd8041b54d6dfab46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775273d expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845544.887124:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08800, rc 0) 00000100:00100000:1.0:1788845544.887187:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:13882:x1875740180193536:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 147us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845544.887193:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 89 00000100:00100000:3.0:1788845544.891624:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845544.891746:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180193664 00000100:00100000:1.0:1788845544.891847:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180193664 00000100:00100000:1.0:1788845544.891908:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 90 00000100:00100000:1.0:1788845544.891919:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:13882:x1875740180193664:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788845544.892278:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:13882:x1875740180193664:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 359us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845544.892286:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 90 00000100:00100000:2.0:1788845544.900189:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845544.900345:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180193792 00000100:00100000:0.0:1788845544.900357:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180193792 00000100:00100000:0.0:1788845544.900459:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 91 00000100:00100000:0.0:1788845544.900472:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:13882:x1875740180193792:12345-192.168.206.35@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788845544.900741:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:13882:x1875740180193792:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 271us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845544.900750:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 91 00000100:00100000:0.0:1788845544.903476:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.903570:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180193920 00000100:00100000:2.0:1788845544.903580:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180193920 00000100:00100000:2.0:1788845544.903636:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 92 00000100:00100000:2.0:1788845544.903657:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb75fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:13889:x1875740180193920:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845544.903962:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb75fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:13889:x1875740180193920:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 316us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845544.903970:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 92 00000100:00100000:3.0:1788845544.927109:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845544.927326:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180194048 00000100:00100000:1.0:1788845544.927336:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180194048 00000100:00100000:1.0:1788845544.927423:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:1.0:1788845544.927434:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:13889:x1875740180194048:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845544.927761:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:13889:x1875740180194048:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 320us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845544.927770:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:3.0:1788845544.930466:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845544.933186:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180194176 00000100:00100000:1.0:1788845544.933204:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180194176 00000100:00100000:1.0:1788845544.933289:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00100000:1.0:1788845544.933301:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:13882:x1875740180194176:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788845544.933318:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845544.933336:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfab4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce12007752767 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845544.933398:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfab4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752767 expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845544.933410:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc08400/0xd8041b54d6dfab4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752767 expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845544.933439:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08400, rc 0) 00000100:00100000:1.0:1788845544.933511:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+12:13882:x1875740180194176:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 212us (3066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845544.933518:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00100000:0.0:1788845544.938097:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.938201:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180194304 00000100:00100000:2.0:1788845544.938212:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180194304 00000100:00100000:2.0:1788845544.938277:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 95 00000100:00100000:2.0:1788845544.938286:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+12:13882:x1875740180194304:12345-192.168.206.35@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788845544.938313:0:14368:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788845544.938342:0:14368:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788845544.938347:0:14368:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788845544.938350:0:14368:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788845544.938353:0:14368:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788845544.940124:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+12:13882:x1875740180194304:12345-192.168.206.35@tcp:256:mount.lustre.0 Request processed in 1820us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845544.940138:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 95 00000100:00100000:3.0:1788845544.946333:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.947094:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180194432 00000100:00100000:2.0:1788845544.947133:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180194432 00000100:00100000:2.0:1788845544.947202:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 96 00000100:00100000:2.0:1788845544.947213:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+12:13882:x1875740180194432:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788845544.947296:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845544.947316:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeaeeb9200/0xd8041b54d6dfab54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce1200775276e expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845544.947349:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeaeeb9200/0xd8041b54d6dfab54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775276e expref: 13 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845544.947359:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeaeeb9200/0xd8041b54d6dfab54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775276e expref: 13 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845544.947399:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb9200, rc 0) 00000100:00100000:2.0:1788845544.947467:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13882:x1875740180194432:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 256us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845544.947474:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 96 00000100:00100000:0.0:1788845544.950707:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.951600:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180194560 00000100:00100000:2.0:1788845544.951623:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180194560 00000100:00100000:2.0:1788845544.951693:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 97 00000100:00100000:2.0:1788845544.951704:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13882:x1875740180194560:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788845544.952655:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13882:x1875740180194560:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 948us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845544.952671:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 97 00000100:00100000:3.0:1788845544.956662:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.956778:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180194688 00000100:00100000:2.0:1788845544.956789:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180194688 00000100:00100000:2.0:1788845544.956847:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:2.0:1788845544.956858:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13882:x1875740180194688:12345-192.168.206.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788845544.957118:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13882:x1875740180194688:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 252us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845544.957127:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:0.0:1788845544.962139:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.962689:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180194816 00000100:00100000:2.0:1788845544.962699:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180194816 00000100:00100000:2.0:1788845544.962762:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:2.0:1788845544.962773:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb54b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13894:x1875740180194816:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845544.963226:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb54b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13894:x1875740180194816:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 452us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845544.963235:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:0.0:1788845544.969807:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.970329:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180194944 00000100:00100000:2.0:1788845544.970340:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180194944 00000100:00100000:2.0:1788845544.974708:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 100 00000100:00100000:2.0:1788845544.974736:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13894:x1875740180194944:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845544.975018:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13894:x1875740180194944:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 295us (5223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845544.975026:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 100 00000100:00100000:2.0:1788845544.986564:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.986616:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.986650:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.986839:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.986899:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180195584 00000100:00100000:2.0:1788845544.986909:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180195584 00000100:00100000:2.0:1788845544.986961:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180195712 00000100:00100000:2.0:1788845544.986964:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180195712 00000100:00100000:3.0:1788845544.986985:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:2.0:1788845544.986998:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:3.0:1788845544.987002:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:2373:x1875740180195584:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845544.987025:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+5:2373:x1875740180195712:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1788845544.987078:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:2373:x1875740180195584:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 83us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845544.987088:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:0.0:1788845544.987605:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180195072 00000100:00100000:0.0:1788845544.987611:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180195072 00000100:00100000:0.0:1788845544.987636:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180195456 00000100:00100000:0.0:1788845544.987639:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180195456 00000100:00100000:0.0:1788845544.987659:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:0.0:1788845544.987747:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:2373:x1875740180195456:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845544.987826:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+5:2373:x1875740180195712:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 804us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845544.987834:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:2.0:1788845544.987869:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788845544.987877:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788845544.988017:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:2.0:1788845544.988022:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2371:x1875740180195072:12345-192.168.206.35@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788845544.988046:0:14375:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 11985c56-cf2e-4eab-9399-f2abe779dd74@192.168.206.35@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:2.0:1788845544.988107:0:14375:0:(genops.c:1385:class_connect()) connect: client 11985c56-cf2e-4eab-9399-f2abe779dd74, cookie 0xd8041b54d6dfab5b 00000004:00100000:2.0:1788845544.988137:0:14375:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788845544.988265:0:14375:0:(import.c:65:import_set_state_nolock()) ffff92ae831b4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845544.988556:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11985c56-cf2e-4eab-9399-f2abe779dd74+6:2371:x1875740180195072:12345-192.168.206.35@tcp:38:mount.lustre.0 Request processed in 531us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845544.988563:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:0.0:1788845544.989566:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:2373:x1875740180195456:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 1818us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845544.989576:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:0.0:1788845544.991806:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845544.991894:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180195200 00000100:00100000:2.0:1788845544.991904:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180195200 00000100:00100000:2.0:1788845544.991980:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:2.0:1788845544.991991:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11985c56-cf2e-4eab-9399-f2abe779dd74+6:0:x1875740180195200:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788845544.992036:0:14375:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788845544.992115:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11985c56-cf2e-4eab-9399-f2abe779dd74+6:0:x1875740180195200:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 118us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845544.992123:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00080000:0.0:1788845544.993470:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845544.994693:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845544.994856:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180195328 00000100:00100000:1.0:1788845544.995072:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180195328 00000100:00100000:1.0:1788845544.995207:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:1.0:1788845544.995218:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11985c56-cf2e-4eab-9399-f2abe779dd74+6:13882:x1875740180195328:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788845544.995312:0:14373:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788845544.996435:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11985c56-cf2e-4eab-9399-f2abe779dd74+6:13882:x1875740180195328:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 1213us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845544.996445:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:1.0:1788845544.999844:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845545.000434:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180195840 00000100:00100000:2.0:1788845545.000446:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180195840 00000100:00100000:2.0:1788845545.000542:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:2.0:1788845545.000554:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11985c56-cf2e-4eab-9399-f2abe779dd74+6:13882:x1875740180195840:12345-192.168.206.35@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788845545.000637:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11985c56-cf2e-4eab-9399-f2abe779dd74+6:13882:x1875740180195840:12345-192.168.206.35@tcp:40:mount.lustre.0 Request processed in 86us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845545.000645:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:0.0:1788845545.003651:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845545.003836:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180195968 00000100:00100000:3.0:1788845545.003847:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180195968 00000100:00100000:3.0:1788845545.003897:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:3.0:1788845545.003906:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875740180195968:12345-192.168.206.35@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788845545.003935:0:15054:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 11985c56-cf2e-4eab-9399-f2abe779dd74@192.168.206.35@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:3.0:1788845545.003973:0:15054:0:(genops.c:1385:class_connect()) connect: client 11985c56-cf2e-4eab-9399-f2abe779dd74, cookie 0xd8041b54d6dfab62 00002000:00100000:3.0:1788845545.004171:0:15054:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 11985c56-cf2e-4eab-9399-f2abe779dd74/ffff92aebca05800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788845545.004191:0:15054:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788845545.004316:0:15054:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788845545.004347:0:15054:0:(import.c:65:import_set_state_nolock()) ffff92aebca00000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845545.004988:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11985c56-cf2e-4eab-9399-f2abe779dd74+6:2371:x1875740180195968:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 1077us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845545.004997:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:1.0:1788845545.005010:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845545.005150:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180196096 00000100:00100000:3.0:1788845545.005156:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180196096 00000100:00100000:3.0:1788845545.005270:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:3.0:1788845545.005276:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875740180196096:12345-192.168.206.35@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788845545.005301:0:15054:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 11985c56-cf2e-4eab-9399-f2abe779dd74@192.168.206.35@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:3.0:1788845545.005327:0:15054:0:(genops.c:1385:class_connect()) connect: client 11985c56-cf2e-4eab-9399-f2abe779dd74, cookie 0xd8041b54d6dfab69 00002000:00100000:3.0:1788845545.005335:0:15054:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 11985c56-cf2e-4eab-9399-f2abe779dd74/ffff92aebca03800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788845545.005342:0:15054:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788845545.006296:0:15054:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788845545.006331:0:15054:0:(import.c:65:import_set_state_nolock()) ffff92aebca04800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845545.006524:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11985c56-cf2e-4eab-9399-f2abe779dd74+6:2371:x1875740180196096:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 1245us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845545.006553:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:1.0:1788845545.006889:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845545.006960:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180196224 00000100:00100000:0.0:1788845545.006972:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180196224 00000100:00100000:0.0:1788845545.007016:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:0.0:1788845545.007025:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+6:13882:x1875740180196224:12345-192.168.206.35@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788845545.007260:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788845545.007328:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+6:13882:x1875740180196224:12345-192.168.206.35@tcp:33:mount.lustre.0 Request processed in 304us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845545.007335:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:0.0:1788845545.141109:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845545.141789:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180196352 00000100:00100000:1.0:1788845545.141801:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180196352 00000100:00100000:1.0:1788845545.141916:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:1.0:1788845545.141928:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11985c56-cf2e-4eab-9399-f2abe779dd74+6:13915:x1875740180196352:12345-192.168.206.35@tcp:101:mkdir.0 00010000:00010000:1.0:1788845545.141948:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845545.141969:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfab70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752798 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845545.142032:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845545.142065:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845545.142079:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845545.142650:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845545.142655:0:14373:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845545.142680:0:14373:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845545.142710:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfab70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752798 expref: 8 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845545.142729:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752798 expref: 7 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845545.142738:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:1.0:1788845545.142741:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845545.142744:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08e00, rc 0) 00000100:00100000:1.0:1788845545.142857:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11985c56-cf2e-4eab-9399-f2abe779dd74+7:13915:x1875740180196352:12345-192.168.206.35@tcp:101:mkdir.0 Request processed in 931us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845545.142863:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00010000:00010000:3.0:1788845545.499492:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845546.526276:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845546.587625:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845546.587652:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189615488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845546.587707:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189615616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845546.587726:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845546.589511:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189615488 00000100:00100000:0.0:1788845546.589527:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189615488 00000100:00100000:0.0:1788845546.589622:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845546.589633:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189615488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845546.589674:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788845546.589690:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845546.590555:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189616000:0@lo:400:kworker.0 00000100:00100000:2.0:1788845546.593937:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845546.594118:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189615872:0@lo:400:kworker.0 00000100:00100000:2.0:1788845546.594118:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189616128:0@lo:400:kworker.0 00000100:00100000:3.0:1788845546.594461:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845546.594464:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845546.594504:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788845546.594513:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d9107f4-aa08-4701-832e-746d9df521c4:3283:1875740189615744:0@lo:400:kworker.0 00000100:00100000:2.0:1788845546.594548:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845546.595034:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189616128 00000100:00100000:2.0:1788845546.595043:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189616128 00000100:00100000:3.0:1788845546.595061:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189615872 00000100:00100000:3.0:1788845546.595068:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189615872 00000100:00100000:2.0:1788845546.595111:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845546.595116:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788845546.595125:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189616128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845546.595129:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189615872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845546.595190:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189616128:12345-0@lo:400:kworker.0 Request processed in 68us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845546.595192:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189615872:12345-0@lo:400:kworker.0 Request processed in 68us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845546.595204:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845546.595207:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788845546.595241:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189615744 00000100:00100000:2.0:1788845546.595247:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189615744 00000100:00100000:3.0:1788845546.595262:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189615872:0@lo:400:kworker.0 00000100:00100000:2.0:1788845546.595280:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788845546.595290:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+19:3283:x1875740189615744:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788845546.595310:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845546.595316:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845546.595327:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+19:3283:x1875740189615744:12345-0@lo:400:kworker.0 Request processed in 39us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845546.595341:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d9107f4-aa08-4701-832e-746d9df521c4:3283:1875740189615744:0@lo:400:kworker.0 00000100:00100000:3.0:1788845546.595350:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189616256:0@lo:400:kworker.0 00000100:00100000:2.0:1788845546.595357:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788845546.596377:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845546.596422:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189616128:0@lo:400:kworker.0 00000100:00100000:2.0:1788845546.597086:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189616256 00000100:00100000:2.0:1788845546.597094:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189616256 00000100:00100000:2.0:1788845546.597157:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845546.597165:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189616256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845546.597229:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875740189616256:12345-0@lo:400:kworker.0 Request processed in 64us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845546.597235:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788845546.597262:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845546.597298:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875740189616256:0@lo:400:kworker.0 00000100:00100000:0.0:1788845546.601697:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189615488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12054us (13959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845546.601713:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845546.601748:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189615616 00000100:00100000:0.0:1788845546.601757:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189615616 00000100:00100000:0.0:1788845546.601787:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788845546.601794:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189615616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845546.601830:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845546.603051:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189615488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845546.604762:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845546.605076:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189615616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3278us (11145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845546.605090:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845546.605183:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189615616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845546.605211:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189616000 00000100:00100000:2.0:1788845546.605221:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189616000 00000100:00100000:2.0:1788845546.605275:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788845546.605285:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189616000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845546.605344:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875740189616000:12345-0@lo:400:kworker.0 Request processed in 61us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845546.605352:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788845546.605486:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc76df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875740189616000:0@lo:400:kworker.0 00010000:00010000:0.0:1788845547.547763:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788845547.642493:0:16337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1788845547.672470:0:6682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11985c56-cf2e-4eab-9399-f2abe779dd74 00000001:00100000:0.0:1788845547.672487:0:6682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3582157f-7d60-4d28-a42b-ea8dc01a2de4 00000001:00100000:1.0:1788845547.684942:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 11985c56-cf2e-4eab-9399-f2abe779dd74 00000001:00100000:1.0:1788845547.684959:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3582157f-7d60-4d28-a42b-ea8dc01a2de4 00010000:00010000:1.0:1788845548.572425:0:15885:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845549.596064:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788845549.725299:0:7612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11985c56-cf2e-4eab-9399-f2abe779dd74 00000100:00100000:1.0:1788845550.306068:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845550.306116:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845550.306157:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845550.306184:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845550.306205:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845550.306226:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845550.306228:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180196992 00000100:00100000:0.0:1788845550.306239:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180196992 00000100:00100000:1.0:1788845550.306253:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845550.306319:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180196608 00000100:00100000:0.0:1788845550.306323:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180196608 00000100:00100000:0.0:1788845550.306349:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:0.0:1788845550.306359:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+6:2373:x1875740180196992:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845550.306473:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+6:2373:x1875740180196992:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 116us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845550.306481:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:0.0:1788845550.306497:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:0.0:1788845550.306503:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:2373:x1875740180196608:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845550.306529:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:2373:x1875740180196608:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845550.306536:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:0.0:1788845550.306558:0:15883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180196736 00000100:00100000:0.0:1788845550.306561:0:15883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180196736 00000100:00100000:0.0:1788845550.306580:0:15883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180197248 00000100:00100000:0.0:1788845550.306582:0:15883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180197248 00000100:00100000:0.0:1788845550.306593:0:15883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180196864 00000100:00100000:0.0:1788845550.306595:0:15883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180196864 00000100:00100000:0.0:1788845550.306605:0:15883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180197120 00000100:00100000:0.0:1788845550.306608:0:15883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180197120 00000100:00100000:0.0:1788845550.306621:0:15883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:0.0:1788845550.306627:0:15883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+5:2373:x1875740180196736:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845550.306655:0:15883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+5:2373:x1875740180196736:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 27us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845550.306682:0:15883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:0.0:1788845550.306695:0:15883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:0.0:1788845550.306702:0:15883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11985c56-cf2e-4eab-9399-f2abe779dd74+5:2373:x1875740180197248:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845550.306727:0:15883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11985c56-cf2e-4eab-9399-f2abe779dd74+5:2373:x1875740180197248:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845550.306767:0:15883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:0.0:1788845550.306783:0:15883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:0.0:1788845550.306790:0:15883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+5:2373:x1875740180196864:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845550.306815:0:15883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+5:2373:x1875740180196864:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845550.306821:0:15883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:0.0:1788845550.306832:0:15883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:0.0:1788845550.306838:0:15883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11985c56-cf2e-4eab-9399-f2abe779dd74+5:2373:x1875740180197120:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845550.306859:0:15883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11985c56-cf2e-4eab-9399-f2abe779dd74+5:2373:x1875740180197120:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 21us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845550.306866:0:15883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00080000:0.0:1788845550.306881:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845550.306885:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788845550.306888:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845550.307007:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180196480 00000100:00100000:2.0:1788845550.307013:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180196480 00000100:00100000:2.0:1788845550.307049:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 102 00000100:00100000:2.0:1788845550.307059:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:2373:x1875740180196480:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845550.308116:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:2373:x1875740180196480:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 1053us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845550.308127:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 102 00010000:00010000:2.0:1788845550.627205:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788845550.712498:0:16487:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe956f7830 20000000:00000080:3.0:1788845550.712521:0:16487:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92ad83407400 uarg=0000000000000000 20000000:01000000:3.0:1788845550.712565:0:16487:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788845550.712572:0:16487:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788845550.712578:0:16487:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788845550.714766:0:16488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788845550.715026:0:16487:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788845550.721588:0:16487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788845550.721624:0:16487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.721645:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfa875 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa86e expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.721653:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aeb7fd0000/0xd8041b54d6dfa8c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa8bb expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.721660:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6dfa932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfa92b expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.721671:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfab1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775270c expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.721678:0:16487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92aeaeeb9200/0xd8041b54d6dfab54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775276e expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.721712:0:16487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.721762:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aeaeeb9200/0xd8041b54d6dfab54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775276e expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.721781:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92aeaeeb9200/0xd8041b54d6dfab54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775276e expref: 12 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845550.721797:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd12680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875740189616384:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845550.721972:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfab1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775270c expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.721981:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfab1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775270c expref: 12 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845550.721989:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd12a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875740189616512:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845550.722024:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6dfa932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6dfa92b expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.722032:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6dfa932 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6dfa92b expref: 18 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845550.722041:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd11f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875740189616640:0@lo:104: 00000100:00100000:1.0:1788845550.722073:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845550.722122:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92aeb7fd0000/0xd8041b54d6dfa8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6dfa8bb expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.722142:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92aeb7fd0000/0xd8041b54d6dfa8c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6dfa8bb expref: 18 pid: 14366 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845550.722151:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875740189616768:0@lo:104: 00000100:00100000:1.0:1788845550.722175:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845550.722214:0:16487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfa875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd8041b54d6dfa86e expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.722222:0:16487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfa875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd8041b54d6dfa86e expref: 18 pid: 14366 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845550.722231:0:16487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875740189616896:0@lo:104: 00000100:00100000:1.0:1788845550.722259:0:16487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845550.722269:0:16487:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeae210600 going to sleep for 11 seconds 00000100:00100000:0.0:1788845550.724585:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788845550.724622:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189616640 00000100:00100000:0.0:1788845550.724630:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189616640 00000100:00100000:0.0:1788845550.724672:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189616768 00000100:00100000:0.0:1788845550.724692:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189616768 00000100:00100000:0.0:1788845550.724706:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189616896 00000100:00100000:0.0:1788845550.724709:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189616896 00000100:00100000:0.0:1788845550.724724:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845550.724733:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d9107f4-aa08-4701-832e-746d9df521c4+5:16487:x1875740189616640:12345-0@lo:104: 00010000:00010000:0.0:1788845550.724748:0:14357:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845550.725042:0:14357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845550.725049:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d9107f4-aa08-4701-832e-746d9df521c4+5:16487:x1875740189616640:12345-0@lo:104: Request processed in 318us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845550.725057:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845550.725075:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845550.725082:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d9107f4-aa08-4701-832e-746d9df521c4+4:16487:x1875740189616768:12345-0@lo:104: 00010000:00010000:0.0:1788845550.725098:0:14357:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845550.725196:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788845550.725201:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd11f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875740189616640:0@lo:104: 00010000:00010000:2.0:1788845550.725204:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845550.725213:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875740189616768:0@lo:104: 00010000:00010000:2.0:1788845550.725219:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748b000 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845550.725224:0:14362:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845550.725232:0:14362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845550.725240:0:14362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845550.725246:0:14362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845550.725378:0:14362:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845550.725385:0:14362:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845550.725407:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845550.725426:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aeb748b000/0xd8041b54d6dfa92b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa932 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845550.725441:0:14362:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845550.725444:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845550.725449:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d9107f4-aa08-4701-832e-746d9df521c4:3285:1875740189617024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788845550.725450:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc09a00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:2.0:1788845550.725453:0:14362:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845550.725469:0:14362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845550.725475:0:14362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845550.725481:0:14362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788845550.725486:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845550.725495:0:14362:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845550.725500:0:14362:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845550.725507:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845550.725514:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfa8bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa8c2 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845550.725522:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788845550.725523:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845550.725524:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845550.725527:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d9107f4-aa08-4701-832e-746d9df521c4:3285:1875740189617152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788845550.725527:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845550.725548:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845550.725579:0:14357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788845550.725586:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d9107f4-aa08-4701-832e-746d9df521c4+4:16487:x1875740189616768:12345-0@lo:104: Request processed in 505us (3410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845550.725592:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845550.725685:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189617024 00000100:00100000:3.0:1788845550.725690:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189617024 00010000:00010000:3.0:1788845550.725709:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6dfa932 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa92b expref: 19 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845550.725729:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189617152 00000100:00100000:3.0:1788845550.725733:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189617152 00010000:00010000:3.0:1788845550.725745:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aeb7fd0000/0xd8041b54d6dfa8c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa8bb expref: 20 pid: 14366 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845550.725758:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845550.725765:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d9107f4-aa08-4701-832e-746d9df521c4+20:3285:x1875740189617024:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845550.725771:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1788845550.725775:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788845550.725777:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788845550.725780:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6dfa932 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa92b expref: 20 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.725800:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6dfa932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6dfa92b expref: 20 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.725813:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fc08a00/0xd8041b54d6dfa932 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6dfa92b expref: 20 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.725824:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845550.725852:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d9107f4-aa08-4701-832e-746d9df521c4+19:3285:x1875740189617024:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845550.725859:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845550.725873:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845550.725879:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d9107f4-aa08-4701-832e-746d9df521c4+18:3285:x1875740189617152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845550.725887:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845550.725891:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aeb7fd0000/0xd8041b54d6dfa8c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa8bb expref: 18 pid: 14366 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845550.725892:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788845550.725899:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aeb7fd0000/0xd8041b54d6dfa8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6dfa8bb expref: 18 pid: 14366 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.725908:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeb7fd0000/0xd8041b54d6dfa8c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6dfa8bb expref: 18 pid: 14366 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.725917:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845550.725938:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d9107f4-aa08-4701-832e-746d9df521c4+17:3285:x1875740189617152:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845550.725944:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845550.725972:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d9107f4-aa08-4701-832e-746d9df521c4:3285:1875740189617152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845550.725980:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d9107f4-aa08-4701-832e-746d9df521c4:3285:1875740189617024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845550.726256:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb95dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d9107f4-aa08-4701-832e-746d9df521c4+3:16487:x1875740189616896:12345-0@lo:104: 00010000:00010000:0.0:1788845550.726265:0:14357:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.726410:0:15885:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845550.726561:0:14357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845550.726567:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb95dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d9107f4-aa08-4701-832e-746d9df521c4+3:16487:x1875740189616896:12345-0@lo:104: Request processed in 316us (4309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845550.726580:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845550.726608:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875740189616896:0@lo:104: 00010000:00010000:3.0:1788845550.726644:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845550.726650:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.726657:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb748bc00 already unused, calling callback (ffffffffc1bfac20) 10000000:00010000:3.0:1788845550.726661:0:14361:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.726669:0:14361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845550.726676:0:14361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845550.726682:0:14361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788845550.726711:0:14361:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.726718:0:14361:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845550.726741:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.726749:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff92aeb748bc00/0xd8041b54d6dfa86e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd8041b54d6dfa875 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.726763:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845550.726764:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845550.726766:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845550.726773:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845550.726782:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d9107f4-aa08-4701-832e-746d9df521c4:3284:1875740189617280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845550.726824:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845550.726965:0:16489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189617280 00000100:00100000:1.0:1788845550.726970:0:16489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189617280 00010000:00010000:1.0:1788845550.726987:0:16489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfa875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa86e expref: 17 pid: 14366 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845550.727015:0:16489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845550.727021:0:16489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb3e50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d9107f4-aa08-4701-832e-746d9df521c4+17:3284:x1875740189617280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788845550.727029:0:16489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845550.727034:0:16489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfa875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd8041b54d6dfa86e expref: 17 pid: 14366 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.727048:0:16489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfa875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd8041b54d6dfa86e expref: 17 pid: 14366 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.727059:0:16489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfa875 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd8041b54d6dfa86e expref: 17 pid: 14366 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845550.727070:0:16489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845550.727176:0:16489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb3e50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d9107f4-aa08-4701-832e-746d9df521c4+16:3284:x1875740189617280:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845550.727306:0:16489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845550.727357:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd12680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875740189616384:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845550.727509:0:16487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd12a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16487:1875740189616512:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845550.727536:0:16487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845550.727594:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845550.727611:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d9107f4-aa08-4701-832e-746d9df521c4:3284:1875740189617280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845550.727672:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180197376 00000100:00100000:0.0:1788845550.727677:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180197376 00000100:00100000:3.0:1788845550.727685:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:0.0:1788845550.727697:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92aeaeeb9200/0xd8041b54d6dfab54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775276e expref: 13 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845550.728022:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180197504 00000100:00100000:0.0:1788845550.728027:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180197504 00010000:00010000:0.0:1788845550.728042:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfab1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775270c expref: 14 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845550.729234:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:3.0:1788845550.729250:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+14:2372:x1875740180197376:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845550.729265:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788845550.729287:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:2.0:1788845550.729298:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+14:2372:x1875740180197504:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845550.729307:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845550.729312:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfab1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775270c expref: 14 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.729342:0:14358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92aeaeeb9200/0xd8041b54d6dfab54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775276e expref: 14 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845550.729344:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfab1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775270c expref: 14 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.729354:0:14358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92aeaeeb9200/0xd8041b54d6dfab54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775276e expref: 14 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.729410:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92aeaeeb9200/0xd8041b54d6dfab54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775276e expref: 14 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845550.729410:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fc08c00/0xd8041b54d6dfab1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775270c expref: 14 pid: 14367 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.729437:0:14358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.729445:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845550.729560:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845550.729562:0:14358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.729569:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.729575:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.729591:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.729596:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08000 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845550.729600:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845550.729645:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+12:2372:x1875740180197504:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 348us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845550.729653:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00010000:00010000:3.0:1788845550.729698:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.729723:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845550.729734:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845550.729754:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:2372:x1875740180197376:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 511us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845550.729762:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00010000:00010000:0.0:1788845550.730939:0:16487:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845550.730955:0:16487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845550.730962:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ae8fc08000/0xd8041b54d6dfab7e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845551.644617:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845551.710470:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189617792:0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.710549:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845551.710610:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788845551.710617:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d9107f4-aa08-4701-832e-746d9df521c4:3283:1875740189617408:0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.710648:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845551.710674:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189617920:0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.710698:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845551.710726:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189617536:0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.710766:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845551.710785:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189618048:0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.710812:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845551.710830:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845551.710836:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189617664:0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.710857:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845551.710892:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189617792 00000100:00100000:0.0:1788845551.710899:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189617792 00000100:00100000:0.0:1788845551.710943:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189617920 00000100:00100000:0.0:1788845551.710947:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189617920 00000100:00100000:0.0:1788845551.710971:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189618048 00000100:00100000:0.0:1788845551.710974:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189618048 00000100:00100000:0.0:1788845551.710991:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788845551.711001:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189617792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.711052:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189617792:12345-0@lo:400:kworker.0 Request processed in 53us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845551.711059:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788845551.711076:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788845551.711082:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189617920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.711111:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875740189617920:12345-0@lo:400:kworker.0 Request processed in 29us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845551.711117:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788845551.711128:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788845551.711134:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189618048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.711165:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189618048:12345-0@lo:400:kworker.0 Request processed in 31us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845551.711171:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788845551.711197:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189617408 00000100:00100000:0.0:1788845551.711201:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189617408 00000100:00100000:0.0:1788845551.711230:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788845551.711238:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+16:3283:x1875740189617408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.711269:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+16:3283:x1875740189617408:12345-0@lo:400:kworker.0 Request processed in 32us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845551.711276:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788845551.711307:0:15883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189617536 00000100:00100000:0.0:1788845551.711311:0:15883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189617536 00000100:00100000:0.0:1788845551.711339:0:15883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189617664 00000100:00100000:0.0:1788845551.711342:0:15883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189617664 00000100:00100000:0.0:1788845551.711407:0:15883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845551.711428:0:15883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189617536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.711461:0:15883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189617536:12345-0@lo:400:kworker.0 Request processed in 47us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845551.711467:0:15883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845551.711479:0:15883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845551.711485:0:15883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189617664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.711513:0:15883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189617664:12345-0@lo:400:kworker.0 Request processed in 28us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845551.711520:0:15883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788845551.711544:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845551.711549:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788845551.711551:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845551.711590:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189617664:0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.711601:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189617536:0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.711611:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189618048:0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.711651:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d9107f4-aa08-4701-832e-746d9df521c4:3283:1875740189617408:0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.711661:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875740189617920:0@lo:400:kworker.0 00000100:00100000:0.0:1788845551.711672:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189617792:0@lo:400:kworker.0 00000100:00100000:1.0:1788845551.717072:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189618176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845551.717148:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845551.717204:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189618176 00000100:00100000:1.0:1788845551.717212:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189618176 00000100:00100000:1.0:1788845551.717265:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788845551.717274:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189618176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845551.717309:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845551.717352:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875740189618176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845551.717380:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788845551.717435:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875740189618176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845551.722765:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845551.722796:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189618304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845551.722871:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845551.726717:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189618304 00000100:00100000:3.0:1788845551.726735:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189618304 00000100:00100000:3.0:1788845551.726795:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845551.726806:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189618304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788845551.726846:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845551.726937:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189618304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (4066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845551.726945:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845551.727002:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189618304:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1788845551.899454:0:14370:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788845551.899463:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ae885b2800 from 10 10000000:01000000:1.0:1788845551.899469:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845551.899512:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfab85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845551.899524:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfab85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845551.899535:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfab85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845551.899558:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189618432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845551.899643:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845551.899697:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeae210cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845551.899720:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189618432 00000100:00100000:2.0:1788845551.899728:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189618432 00000100:00100000:2.0:1788845551.899786:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788845551.899796:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+16:14370:x1875740189618432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845551.899809:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845551.899822:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeaeeb8a00/0xd8041b54d6dfab8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfab85 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845551.899844:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeaeeb8a00/0xd8041b54d6dfab8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfab85 expref: 17 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845551.899855:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeaeeb8a00/0xd8041b54d6dfab8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfab85 expref: 17 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845551.899865:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb8a00, rc 0) 00000100:00100000:2.0:1788845551.899913:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+17:14370:x1875740189618432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845551.899920:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788845551.899944:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189618432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845551.899962:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfab85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfab8c expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845551.899971:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfab85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfab8c expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845551.900024:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189618560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845551.900050:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845551.900075:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeae210cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845551.900105:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189618560 00000100:00100000:3.0:1788845551.900117:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189618560 00000100:00100000:3.0:1788845551.900154:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788845551.900168:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+17:14370:x1875740189618560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845551.900464:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+17:14370:x1875740189618560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845551.900473:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788845551.900479:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189618560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845551.900513:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189618688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845551.900567:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845551.900597:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae9e950180 going to sleep for 11 seconds 00000100:00100000:1.0:1788845551.900670:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189618688 00000100:00100000:1.0:1788845551.900675:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189618688 00000100:00100000:1.0:1788845551.900714:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788845551.900722:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+17:14370:x1875740189618688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845551.900957:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+17:14370:x1875740189618688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845551.900964:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788845551.901426:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189618688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788845551.903865:0:16554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788845551.904405:0:14370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788845551.904440:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788845551.904452:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfab85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfab8c expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845551.904464:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09a00/0xd8041b54d6dfab85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfab8c expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845551.904474:0:14370:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788845551.904477:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92aeae520000 from 10 10000000:01000000:1.0:1788845551.904481:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845551.904517:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08a00/0xd8041b54d6dfab93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845551.904526:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08a00/0xd8041b54d6dfab93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845551.904537:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08a00/0xd8041b54d6dfab93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845551.904562:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189618816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845551.904639:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845551.904690:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeae210300 going to sleep for 11 seconds 00000100:00100000:0.0:1788845551.905044:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189618816 00000100:00100000:0.0:1788845551.905051:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189618816 00000100:00100000:0.0:1788845551.905101:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788845551.905111:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+17:14370:x1875740189618816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845551.905124:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845551.905137:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fd1fa00/0xd8041b54d6dfab9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfab93 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845551.905160:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fd1fa00/0xd8041b54d6dfab9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfab93 expref: 18 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845551.905170:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fd1fa00/0xd8041b54d6dfab9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfab93 expref: 18 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845551.905179:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1fa00, rc 0) 00000100:00100000:0.0:1788845551.905233:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+18:14370:x1875740189618816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845551.905240:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788845551.905467:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189618816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845551.905483:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08a00/0xd8041b54d6dfab93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfab9a expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845551.905492:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08a00/0xd8041b54d6dfab93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfab9a expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845551.905546:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189618944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845551.905576:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845551.905608:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98f50c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845551.905940:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189618944 00000100:00100000:1.0:1788845551.905945:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189618944 00000100:00100000:1.0:1788845551.906020:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788845551.906035:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+18:14370:x1875740189618944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845551.906444:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+18:14370:x1875740189618944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 415us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845551.906451:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788845551.906561:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189618944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845551.906677:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ad82f4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189619072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845551.906721:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845551.906845:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae98f50c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845551.906878:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189619072 00000100:00100000:1.0:1788845551.906883:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189619072 00000100:00100000:1.0:1788845551.906913:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788845551.906919:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+18:14370:x1875740189619072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845551.907264:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+18:14370:x1875740189619072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 343us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845551.907271:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788845551.907519:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ad82f4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189619072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788845551.909446:0:16555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788845551.909898:0:14370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788845551.909922:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788845551.909933:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08a00/0xd8041b54d6dfab93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfab9a expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845551.909944:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fc08a00/0xd8041b54d6dfab93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfab9a expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845551.909955:0:14370:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788845551.909958:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92aeadcb1000 from 10 10000000:01000000:1.0:1788845551.909960:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845551.909995:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09e00/0xd8041b54d6dfaba1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845551.910014:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09e00/0xd8041b54d6dfaba1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845551.910025:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09e00/0xd8041b54d6dfaba1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845551.910048:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189619200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845551.910107:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845551.910753:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeae2103c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845551.911009:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189619200 00000100:00100000:2.0:1788845551.911017:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189619200 00000100:00100000:2.0:1788845551.911114:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788845551.911124:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+18:14370:x1875740189619200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845551.911138:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845551.911153:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeaeeb8600/0xd8041b54d6dfaba8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd8041b54d6dfaba1 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845551.911175:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeaeeb8600/0xd8041b54d6dfaba8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd8041b54d6dfaba1 expref: 19 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845551.911186:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeaeeb8600/0xd8041b54d6dfaba8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd8041b54d6dfaba1 expref: 19 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845551.911195:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb8600, rc 0) 00000100:00100000:2.0:1788845551.911246:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+19:14370:x1875740189619200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845551.911253:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788845551.911575:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189619200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845551.911592:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09e00/0xd8041b54d6dfaba1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfaba8 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845551.911604:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09e00/0xd8041b54d6dfaba1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd8041b54d6dfaba8 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845551.911959:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189619328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845551.912004:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845551.912248:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fd8ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788845551.915472:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189619328 00000100:00100000:0.0:1788845551.915488:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189619328 00000100:00100000:0.0:1788845551.915548:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788845551.915558:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+19:14370:x1875740189619328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845551.915903:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d9107f4-aa08-4701-832e-746d9df521c4+19:14370:x1875740189619328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (3897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845551.915918:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788845551.916075:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189619328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845551.916126:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189619456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845551.916168:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845551.916205:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fd8ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788845551.916384:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189619456 00000100:00100000:0.0:1788845551.916389:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189619456 00000100:00100000:0.0:1788845551.916424:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788845551.916431:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+19:14370:x1875740189619456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845551.916570:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d9107f4-aa08-4701-832e-746d9df521c4+19:14370:x1875740189619456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845551.916576:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788845551.916670:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebca14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d9107f4-aa08-4701-832e-746d9df521c4:14370:1875740189619456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788845551.918893:0:16557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788845551.925149:0:14370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788845551.925184:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845551.925195:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09e00/0xd8041b54d6dfaba1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfaba8 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845551.925209:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff92ae8fc09e00/0xd8041b54d6dfaba1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd8041b54d6dfaba8 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845552.416658:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845552.416883:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180197632 00000100:00100000:1.0:1788845552.416893:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180197632 00000100:00100000:1.0:1788845552.416978:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 113 00000100:00100000:1.0:1788845552.416989:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae9e8ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+11:13768:x1875740180197632:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845552.417006:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845552.417022:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfabaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce1200775279f expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845552.417048:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfabaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775279f expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845552.417058:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ae8fc09600/0xd8041b54d6dfabaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775279f expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845552.417067:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09600, rc 0) 00000100:00100000:1.0:1788845552.417129:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae9e8ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+12:13768:x1875740180197632:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 143us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845552.417136:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 113 00000100:00100000:1.0:1788845552.424668:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845552.425056:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180197760 00000100:00100000:2.0:1788845552.425065:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180197760 00000100:00100000:2.0:1788845552.425112:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00100000:2.0:1788845552.425120:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+12:13768:x1875740180197760:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845552.425441:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+12:13768:x1875740180197760:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 319us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845552.425448:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00100000:2.0:1788845552.429018:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845552.429108:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180197888 00000100:00100000:1.0:1788845552.429118:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180197888 00000100:00100000:1.0:1788845552.429195:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 115 00000100:00100000:1.0:1788845552.429204:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+12:13768:x1875740180197888:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845552.429758:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+12:13768:x1875740180197888:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 553us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845552.429767:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 115 00000100:00100000:1.0:1788845552.440322:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845552.440589:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180198016 00000100:00100000:2.0:1788845552.440598:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180198016 00000100:00100000:2.0:1788845552.440724:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:2.0:1788845552.440734:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+12:13768:x1875740180198016:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845552.440761:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845552.440777:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92aeaeeb9800/0xd8041b54d6dfabb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x461ce120077527a6 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845552.440804:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92aeaeeb9800/0xd8041b54d6dfabb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527a6 expref: 13 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845552.440816:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92aeaeeb9800/0xd8041b54d6dfabb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527a6 expref: 13 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845552.440824:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb9800, rc 0) 00000100:00100000:2.0:1788845552.440891:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13768:x1875740180198016:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 158us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845552.440898:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:2.0:1788845552.455546:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845552.457201:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180198144 00000100:00100000:1.0:1788845552.457214:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180198144 00000100:00100000:1.0:1788845552.457270:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 117 00000100:00100000:1.0:1788845552.457280:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13768:x1875740180198144:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845552.457672:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13768:x1875740180198144:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 393us (2138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845552.457680:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 117 00000100:00100000:1.0:1788845552.460695:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845552.460967:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180198272 00000100:00100000:3.0:1788845552.460977:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180198272 00000100:00100000:3.0:1788845552.461062:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 118 00000100:00100000:3.0:1788845552.461072:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13768:x1875740180198272:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845552.461299:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:13768:x1875740180198272:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 227us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845552.461315:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 118 00010000:00010000:2.0:1788845552.668746:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845553.607896:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.607972:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180198400 00000100:00100000:0.0:1788845553.607983:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180198400 00000100:00100000:0.0:1788845553.608077:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:0.0:1788845553.608088:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebca14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:14425:x1875740180198400:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845553.608106:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845553.608124:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfabbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527ad expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608193:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f600/0xd8041b54d6dfabc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608230:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f600/0xd8041b54d6dfabc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608242:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f600/0xd8041b54d6dfabc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608257:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfabcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608264:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfabcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608270:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfabcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608786:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f800/0xd8041b54d6dfabd2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608796:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f800/0xd8041b54d6dfabd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608804:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f800/0xd8041b54d6dfabd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845553.608831:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788845553.608834:0:14374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845553.608871:0:14374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f800/0xd8041b54d6dfabd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608882:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f600/0xd8041b54d6dfabc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608898:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f600/0xd8041b54d6dfabc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608904:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f600/0xd8041b54d6dfabc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608910:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1f600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845553.608927:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f600/0xd8041b54d6dfabc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608935:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f600/0xd8041b54d6dfabc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608947:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:0.0:1788845553.608950:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.608954:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f600/0xd8041b54d6dfabc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608960:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f600/0xd8041b54d6dfabc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608974:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfabcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608980:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfabcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608986:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfabcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.608990:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1f200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845553.609000:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfabcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.609007:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfabcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.609015:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff92ae83de9500) 00010000:00010000:0.0:1788845553.609017:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.609020:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfabcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.609026:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f200/0xd8041b54d6dfabcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.609058:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1fc00/0xd8041b54d6dfabbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527ad expref: 8 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.609071:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f800/0xd8041b54d6dfabd2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527ad expref: 7 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.609079:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:0.0:1788845553.609081:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845553.609084:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fd1f800, rc 0) 00000100:00100000:0.0:1788845553.609155:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebca14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:14425:x1875740180198400:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 1069us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845553.609163:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00080000:2.0:1788845553.609261:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845553.615066:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.615201:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180198656 00000100:00100000:0.0:1788845553.615212:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180198656 00000100:00100000:0.0:1788845553.615278:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:0.0:1788845553.615289:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:14425:x1875740180198656:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845553.615328:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845553.615347:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1e600/0xd8041b54d6dfabd9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527b4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.615465:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6dfabe0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.615479:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6dfabe0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.615490:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6dfabe0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.615505:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfabe7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.615511:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfabe7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.615523:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfabe7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.615896:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031400/0xd8041b54d6dfabee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.615906:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031400/0xd8041b54d6dfabee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.615913:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031400/0xd8041b54d6dfabee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845553.615923:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788845553.616500:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6dfabe0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616509:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6dfabe0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616515:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6dfabe0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616520:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fd1f000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845553.616524:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6dfabe0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616531:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6dfabe0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616543:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ae83de9e00) 00010000:00010000:0.0:1788845553.616545:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.616549:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6dfabe0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616554:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1f000/0xd8041b54d6dfabe0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616566:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfabe7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616571:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfabe7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616576:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfabe7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616590:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845553.616593:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfabe7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616599:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfabe7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616608:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff92ae83de9200) 00010000:00010000:0.0:1788845553.616610:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.616613:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfabe7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.616618:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfabe7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.618766:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1e600/0xd8041b54d6dfabd9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527b4 expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.618794:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031400/0xd8041b54d6dfabee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527b4 expref: 9 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.618804:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845553.618806:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.618809:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031400, rc 0) 00000100:00100000:0.0:1788845553.618883:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+9:14425:x1875740180198656:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 3596us (3828us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788845553.618892:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:3.0:1788845553.625741:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.627706:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180198784 00000100:00100000:0.0:1788845553.627744:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180198784 00000100:00100000:0.0:1788845553.627859:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:0.0:1788845553.627872:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+9:14425:x1875740180198784:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788845553.627992:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+9:14425:x1875740180198784:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 Request processed in 123us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845553.627999:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:3.0:1788845553.686927:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:2.0:1788845553.694092:0:15885:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845553.696818:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180198912 00000100:00100000:1.0:1788845553.696834:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180198912 00000100:00100000:1.0:1788845553.696918:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:1.0:1788845553.696929:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+9:14431:x1875740180198912:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1788845553.696947:0:16251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845553.696965:0:16251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfabfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527bb expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697027:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697055:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697076:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697093:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697100:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697106:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697350:0:16251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697358:0:16251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697411:0:16251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697417:0:16251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845553.697422:0:16251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697429:0:16251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697440:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:1.0:1788845553.697450:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845553.697454:0:16251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697460:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697474:0:16251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697480:0:16251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697486:0:16251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697491:0:16251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845553.697493:0:16251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697499:0:16251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697507:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92ae93b8e100) 00010000:00010000:1.0:1788845553.697509:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845553.697512:0:16251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697517:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697546:0:16251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfabfc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527bb expref: 10 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697563:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:1.0:1788845553.697565:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845553.697569:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfabfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527bb expref: 10 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.697579:0:16251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08c00, rc 0) 00000100:00100000:1.0:1788845553.697646:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+9:14431:x1875740180198912:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 720us (10732us total) trans 0 rc 301/301 00000100:00100000:1.0:1788845553.697653:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:2.0:1788845553.702092:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845553.702249:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180199040 00000100:00100000:1.0:1788845553.702259:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180199040 00000100:00100000:1.0:1788845553.702321:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:1.0:1788845553.702333:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+9:14431:x1875740180199040:12345-192.168.206.35@tcp:700:lfs.0 00000100:00100000:1.0:1788845553.702468:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+9:14431:x1875740180199040:12345-192.168.206.35@tcp:700:lfs.0 Request processed in 137us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845553.702476:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:3.0:1788845553.706984:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845553.707058:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180199296 00000100:00100000:1.0:1788845553.707068:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180199296 00000100:00100000:1.0:1788845553.707130:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:1.0:1788845553.707142:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+9:14431:x1875740180199296:12345-192.168.206.35@tcp:36:lfs.0 00010000:00010000:1.0:1788845553.707209:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845553.707237:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fd1e200/0xd8041b54d6dfab3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752736 expref: 9 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.707261:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:1.0:1788845553.707282:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845553.707563:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.707578:0:14375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752798 expref: 5 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.707586:0:14375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.707623:0:14375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752798 expref: 5 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.707636:0:14375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752798 expref: 5 pid: 14373 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845553.707651:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd10700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14375:1875740189619584:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845553.707744:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb7b3f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845553.711902:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd10700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14375:1875740189619584:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845553.711933:0:14375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845553.713139:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.713328:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180199424 00000100:00100000:0.0:1788845553.713337:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180199424 00010000:00010000:0.0:1788845553.713439:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752798 expref: 6 pid: 14373 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845553.713470:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:0.0:1788845553.713478:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc681500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+6:2372:x1875740180199424:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845553.713493:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845553.713500:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752798 expref: 6 pid: 14373 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.713513:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752798 expref: 6 pid: 14373 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.713537:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfab77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752798 expref: 6 pid: 14373 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.713556:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:0.0:1788845553.713561:0:14359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.713590:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.713597:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.713629:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845553.713657:0:14375:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.713668:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845553.713689:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc681500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+5:2372:x1875740180199424:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 210us (557us total) trans 0 rc 0/0 00010000:00010000:1.0:1788845553.713695:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac18 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845553.713700:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00010000:00010000:1.0:1788845553.713722:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.713732:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788845553.713846:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788845553.715663:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788845553.715683:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.715693:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.715701:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.715707:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845553.715712:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.715719:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.715734:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:0.0:1788845553.715737:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.715741:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.715755:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfac11 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845553.715775:0:14375:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abefa8fe reply state 000000004957a0d3 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845553.715784:0:14375:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845553.715962:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+10:14431:x1875740180199296:12345-192.168.206.35@tcp:36:lfs.0 Request processed in 8817us (8983us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788845553.715971:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00010000:00010000:0.0:1788845553.720588:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.720609:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac18 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.720617:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac18 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.720624:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845553.720628:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac18 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.720636:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac18 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.720650:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92ae93b8e100) 00010000:00010000:0.0:1788845553.720653:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.720658:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac18 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.720683:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfac18 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845553.814789:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845553.814887:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180199552 00000100:00100000:1.0:1788845553.814897:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180199552 00000100:00100000:1.0:1788845553.815015:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:1.0:1788845553.815027:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+9:14439:x1875740180199552:12345-192.168.206.35@tcp:101:lctl.0 00010000:00010000:1.0:1788845553.815051:0:16251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845553.815071:0:16251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527c2 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.815138:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfac26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.815152:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfac26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.815164:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfac26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845553.815213:0:16251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845553.815217:0:16251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845553.815255:0:16251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfac26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.815280:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527c2 expref: 11 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.815314:0:16251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc09c00/0xd8041b54d6dfac26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527c2 expref: 10 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.815323:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e200) 00010000:00010000:1.0:1788845553.815326:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845553.815329:0:16251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc09c00, rc 0) 00000100:00100000:1.0:1788845553.815442:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+10:14439:x1875740180199552:12345-192.168.206.35@tcp:101:lctl.0 Request processed in 418us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845553.815450:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:3.0:1788845553.838577:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.839182:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180199680 00000100:00100000:0.0:1788845553.839193:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180199680 00000100:00100000:0.0:1788845553.839266:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:0.0:1788845553.839278:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+5:14440:x1875740180199680:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845553.839297:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845553.839318:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfac2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527c9 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.839426:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfac34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.839440:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfac34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.839451:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfac34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845553.839498:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788845553.839501:0:14374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845553.839519:0:14374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfac34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.839541:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfac2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527c9 expref: 7 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.839571:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031600/0xd8041b54d6dfac34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527c9 expref: 6 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.839602:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e200) 00010000:00010000:0.0:1788845553.839605:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845553.839609:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031600, rc 0) 00000100:00100000:0.0:1788845553.839668:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+6:14440:x1875740180199680:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 393us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845553.839675:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:3.0:1788845553.843002:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.843099:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180199808 00000100:00100000:0.0:1788845553.843109:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180199808 00000100:00100000:0.0:1788845553.843166:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:0.0:1788845553.843189:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11985c56-cf2e-4eab-9399-f2abe779dd74+6:14440:x1875740180199808:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845553.843208:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845553.843226:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfac3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527d0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843287:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfac42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843301:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfac42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843311:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfac42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843512:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843523:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843553:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843656:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfac50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843664:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfac50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843670:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfac50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845553.843703:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788845553.843707:0:14373:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845553.843722:0:14373:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfac50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843733:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfac42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843739:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfac42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843745:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfac42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843750:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845553.843754:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfac42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843761:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfac42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843779:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e200) 00010000:00010000:0.0:1788845553.843781:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.843785:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfac42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843792:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfac42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843808:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843814:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843819:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843824:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845553.843827:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843833:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843840:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92ae83de9400) 00010000:00010000:0.0:1788845553.843842:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.843844:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843850:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843893:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfac3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527d0 expref: 8 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843905:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfac50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527d0 expref: 7 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.843912:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ae83de9200) 00010000:00010000:0.0:1788845553.843914:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845553.843916:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845553.843987:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11985c56-cf2e-4eab-9399-f2abe779dd74+7:14440:x1875740180199808:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 810us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845553.843994:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:3.0:1788845553.848788:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.849162:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180200064 00000100:00100000:0.0:1788845553.849171:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180200064 00000100:00100000:0.0:1788845553.849423:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:0.0:1788845553.849433:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+7:14440:x1875740180200064:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845553.849453:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845553.849470:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfac57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527d7 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845553.849555:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788845553.849679:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfac57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527d7 expref: 9 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.849692:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e200) 00010000:00010000:0.0:1788845553.849695:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845553.849717:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfac57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527d7 expref: 9 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.849730:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031200, rc 0) 00000100:00100000:0.0:1788845553.849791:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+8:14440:x1875740180200064:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 360us (1017us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788845553.849798:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:3.0:1788845553.852244:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845553.852445:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180200320 00000100:00100000:1.0:1788845553.852455:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180200320 00000100:00100000:1.0:1788845553.852518:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:1.0:1788845553.852530:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11985c56-cf2e-4eab-9399-f2abe779dd74+8:14440:x1875740180200320:12345-192.168.206.35@tcp:36:lfs.0 00010000:00010000:1.0:1788845553.852606:0:16251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845553.852632:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfac50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527d0 expref: 8 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.852653:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ae83de9200) 00010000:00010000:1.0:1788845553.852664:0:16251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845553.852688:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.852700:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.852711:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845553.853565:0:16251:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008ba68dd reply state 0000000048abca43 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845553.853579:0:16251:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788845553.853588:0:16251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788845553.853733:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11985c56-cf2e-4eab-9399-f2abe779dd74+9:14440:x1875740180200320:12345-192.168.206.35@tcp:36:lfs.0 Request processed in 1203us (1497us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788845553.853741:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 24 00010000:00010000:1.0:1788845553.855755:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.855773:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.855780:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.855786:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845553.855790:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.855798:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.855813:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ae93b8e500) 00010000:00010000:1.0:1788845553.855816:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788845553.855821:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.855827:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfac65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845553.857306:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.857417:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180200576 00000100:00100000:0.0:1788845553.857427:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180200576 00000100:00100000:0.0:1788845553.857479:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:0.0:1788845553.857488:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+8:14440:x1875740180200576:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845553.857726:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+9:14440:x1875740180200576:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 238us (430us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788845553.857734:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:3.0:1788845553.861314:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845553.861819:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180200832 00000100:00100000:2.0:1788845553.861829:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180200832 00000100:00100000:2.0:1788845553.861929:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:2.0:1788845553.861940:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11985c56-cf2e-4eab-9399-f2abe779dd74+9:14440:x1875740180200832:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845553.861963:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845553.861984:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfac6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527de expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862193:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfac73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862208:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfac73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862220:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfac73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862234:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfac7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862241:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfac7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862248:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfac7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845553.862570:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788845553.862666:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfac73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862674:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfac73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862680:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfac73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862686:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeaeeb8000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845553.862690:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfac73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862709:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfac73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862722:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e200) 00010000:00010000:2.0:1788845553.862725:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845553.862730:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfac73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862736:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfac73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862750:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfac7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862756:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfac7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862763:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfac7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862768:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeaeeb8800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845553.862771:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfac7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862777:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfac7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862785:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92ae82b8f400) 00010000:00010000:2.0:1788845553.862787:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845553.862790:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfac7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862806:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfac7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862844:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfac6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527de expref: 11 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862854:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e200) 00010000:00010000:2.0:1788845553.862856:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845553.862860:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfac6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527de expref: 11 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845553.862867:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb9200, rc 0) 00000100:00100000:2.0:1788845553.862998:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11985c56-cf2e-4eab-9399-f2abe779dd74+10:14440:x1875740180200832:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1060us (1695us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788845553.863005:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:3.0:1788845553.865746:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.866689:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180200960 00000100:00100000:0.0:1788845553.866701:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180200960 00000100:00100000:0.0:1788845553.866757:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:0.0:1788845553.866766:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+10:14440:x1875740180200960:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845553.866789:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845553.866811:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfac88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527e5 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.866904:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.866929:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.866961:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845553.866988:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788845553.866992:0:14374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845553.867010:0:14374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.867034:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfac88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527e5 expref: 12 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.867052:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527e5 expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.867069:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:0.0:1788845553.867073:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845553.867076:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030600, rc 0) 00000100:00100000:0.0:1788845553.867132:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+11:14440:x1875740180200960:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 367us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845553.867140:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:0.0:1788845553.870681:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.870721:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180201088 00000100:00100000:0.0:1788845553.870731:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180201088 00000100:00100000:0.0:1788845553.870785:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:0.0:1788845553.870795:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+11:14440:x1875740180201088:12345-192.168.206.35@tcp:37:lfs.0 00000100:00100000:1.0:1788845553.875952:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+11:14440:x1875740180201088:12345-192.168.206.35@tcp:37:lfs.0 Request processed in 5144us (5271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845553.875976:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:3.0:1788845553.879569:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.879646:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180201344 00000100:00100000:0.0:1788845553.879656:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180201344 00000100:00100000:0.0:1788845553.879734:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:0.0:1788845553.879743:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fdf9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11985c56-cf2e-4eab-9399-f2abe779dd74+11:14440:x1875740180201344:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845553.880052:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fdf9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11985c56-cf2e-4eab-9399-f2abe779dd74+12:14440:x1875740180201344:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 310us (496us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788845553.880060:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:1.0:1788845553.927809:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.927906:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180201472 00000100:00100000:0.0:1788845553.927977:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180201472 00000100:00100000:0.0:1788845553.928704:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:0.0:1788845553.928719:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+10:14447:x1875740180201472:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1788845553.928738:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845553.928757:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfac96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527ec expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.928831:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfac9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.928846:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfac9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.928859:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfac9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.928877:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfaca4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.928886:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfaca4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.928894:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfaca4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929025:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfacab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929036:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfacab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929044:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfacab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845553.929093:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788845553.929098:0:14374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845553.929143:0:14374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfacab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929156:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfac9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929162:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfac9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929168:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfac9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929186:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845553.929191:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfac9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929199:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfac9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929210:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e200) 00010000:00010000:0.0:1788845553.929220:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.929225:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfac9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929231:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfac9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929247:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfaca4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929252:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfaca4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929258:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfaca4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929264:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845553.929267:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfaca4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929273:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfaca4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929282:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92ae83de9500) 00010000:00010000:0.0:1788845553.929284:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.929287:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfaca4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929292:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfaca4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929323:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfac96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527ec expref: 12 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929348:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031800/0xd8041b54d6dfacab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527ec expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.929356:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:0.0:1788845553.929358:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788845553.929660:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031800, rc 0) 00000100:00100000:1.0:1788845553.929884:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+11:14447:x1875740180201472:12345-192.168.206.35@tcp:101:bash.0 Request processed in 1166us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845553.929892:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:3.0:1788845553.932641:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845553.932875:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180201728 00000100:00100000:1.0:1788845553.932886:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180201728 00000100:00100000:1.0:1788845553.933000:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:1.0:1788845553.933013:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+11:14447:x1875740180201728:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1788845553.933034:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845553.933055:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfacb2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527f3 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.933184:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.933201:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527e5 expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.933209:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.933245:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527e5 expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.933282:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527e5 expref: 11 pid: 14374 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845553.933297:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14374:1875740189619712:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845553.933414:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb7b3fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845553.935993:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845553.936059:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180201856 00000100:00100000:3.0:1788845553.936074:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180201856 00010000:00010000:3.0:1788845553.936112:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527e5 expref: 12 pid: 14374 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845553.936147:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:3.0:1788845553.936156:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11985c56-cf2e-4eab-9399-f2abe779dd74+12:2373:x1875740180201856:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845553.936204:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845553.936211:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527e5 expref: 12 pid: 14374 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845553.936224:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527e5 expref: 12 pid: 14374 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845553.936245:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:3.0:1788845553.936250:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845553.936259:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845553.936266:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845553.936283:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845553.936331:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11985c56-cf2e-4eab-9399-f2abe779dd74+12:2373:x1875740180201856:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 175us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845553.936338:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00010000:00010000:1.0:1788845553.937593:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfac8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527e5 expref: 11 pid: 14374 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845553.937619:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14374:1875740189619712:192.168.206.35@tcp:104: 00010000:00010000:1.0:1788845553.937641:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.937650:0:14374:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.937655:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.937679:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfacc0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.937687:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfacc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.937694:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfacc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.939730:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfacc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.939765:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfacc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.939777:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfacc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845553.939789:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788845553.939820:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.939827:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.939833:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.939839:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08000 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845553.939844:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.939852:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.939863:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:1.0:1788845553.939866:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845553.939869:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.939875:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08000/0xd8041b54d6dfacb9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845553.939889:0:14374:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac3e47dc reply state 000000006df58183 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfacc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845553.939904:0:14374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788845553.939953:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08600/0xd8041b54d6dfacb2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527f3 expref: 14 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.939968:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfacc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527f3 expref: 13 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.939974:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:1.0:1788845553.939977:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788845553.939979:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae8fc08e00, rc 0) 00000100:00100000:1.0:1788845553.940052:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+14:14447:x1875740180201728:12345-192.168.206.35@tcp:101:bash.0 Request processed in 7042us (7423us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788845553.940060:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 28 00010000:00010000:0.0:1788845553.945530:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfacc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.945551:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfacc0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.945560:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfacc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.945566:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae8fc08c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845553.945572:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfacc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.945580:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfacc0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.945595:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff92ae93b8e500) 00010000:00010000:0.0:1788845553.945598:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845553.945603:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfacc0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845553.945609:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08c00/0xd8041b54d6dfacc0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788845553.949784:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788845553.949949:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845553.950046:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180201984 00000100:00100000:1.0:1788845553.950058:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180201984 00000100:00100000:1.0:1788845553.950157:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:1.0:1788845553.950169:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+13:14447:x1875740180201984:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1788845553.950193:0:16251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845553.950215:0:16251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53a00/0xd8041b54d6dfacd5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce120077527fa expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.950280:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.950293:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.950320:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845553.950388:0:16251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788845553.950392:0:16251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845553.950424:0:16251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.950434:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.950458:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53a00/0xd8041b54d6dfacd5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527fa expref: 15 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.950476:0:16251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527fa expref: 14 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845553.950484:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:1.0:1788845553.950486:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845553.950490:0:16251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a52200, rc 0) 00000100:00100000:1.0:1788845553.950554:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+14:14447:x1875740180201984:12345-192.168.206.35@tcp:101:bash.0 Request processed in 388us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845553.950561:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:2.0:1788845553.952994:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845553.953083:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180202240 00000100:00100000:0.0:1788845553.953093:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180202240 00000100:00100000:0.0:1788845553.953204:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:0.0:1788845553.953219:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+14:14447:x1875740180202240:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:0.0:1788845553.953633:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+15:14447:x1875740180202240:12345-192.168.206.35@tcp:35:bash.0 Request processed in 418us (646us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788845553.953641:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:3.0:1788845554.019514:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845554.019552:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180202496 00000100:00100000:0.0:1788845554.019564:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180202496 00000100:00100000:0.0:1788845554.019633:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:0.0:1788845554.019644:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+15:14457:x1875740180202496:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1788845554.019669:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845554.019692:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dface3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752801 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845554.019793:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788845554.019926:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dface3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752801 expref: 17 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.019942:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ae93b8e200) 00010000:00010000:0.0:1788845554.019945:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845554.019950:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dface3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752801 expref: 17 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.019967:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80031200, rc 0) 00000100:00100000:0.0:1788845554.020052:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+16:14457:x1875740180202496:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 410us (558us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788845554.020060:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:3.0:1788845554.024825:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845554.024926:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180202752 00000100:00100000:1.0:1788845554.024936:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180202752 00000100:00100000:1.0:1788845554.024999:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:1.0:1788845554.025010:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+16:14457:x1875740180202752:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:1.0:1788845554.025259:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+17:14457:x1875740180202752:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 250us (448us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788845554.025282:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:3.0:1788845554.084709:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845554.086852:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180203008 00000100:00100000:2.0:1788845554.086869:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180203008 00000100:00100000:2.0:1788845554.086951:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:2.0:1788845554.086963:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+17:14460:x1875740180203008:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1788845554.086986:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845554.087005:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfacf1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752808 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.087111:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfacf8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.087146:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfacf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.087157:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfacf8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845554.087169:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788845554.087322:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfacf1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752808 expref: 20 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.087342:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfacf8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752808 expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.087350:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:2.0:1788845554.087352:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845554.087356:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb8800, rc 0) 00000100:00100000:2.0:1788845554.087463:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+19:14460:x1875740180203008:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 503us (2766us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788845554.087843:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:3.0:1788845554.094711:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845554.095334:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180203136 00000100:00100000:0.0:1788845554.095346:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180203136 00000100:00100000:0.0:1788845554.095445:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:0.0:1788845554.095457:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+19:14460:x1875740180203136:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:0.0:1788845554.095536:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfad06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.095554:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfad06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.095566:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfad06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.095594:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfad06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.095601:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfad06 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.095608:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfad06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.095614:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845554.095618:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfad06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.095625:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfad06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.095661:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:0.0:1788845554.095664:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845554.095669:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfad06 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.095675:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfad06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845554.095760:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+19:14460:x1875740180203136:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 304us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845554.095769:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:3.0:1788845554.096087:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845554.096414:0:16489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180203264 00000100:00100000:2.0:1788845554.096421:0:16489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180203264 00000100:00100000:2.0:1788845554.096476:0:16489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:2.0:1788845554.096486:0:16489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+19:2375:x1875740180203264:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845554.096497:0:16489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845554.096513:0:16489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfacf8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752808 expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.096542:0:16489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:2.0:1788845554.096546:0:16489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845554.096575:0:16489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+18:2375:x1875740180203264:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 90us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845554.096582:0:16489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:3.0:1788845554.101433:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845554.101605:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180203520 00000100:00100000:0.0:1788845554.101615:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180203520 00000100:00100000:0.0:1788845554.101677:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:0.0:1788845554.101689:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+18:14460:x1875740180203520:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1788845554.101925:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+19:14460:x1875740180203520:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 238us (503us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788845554.101933:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:0.0:1788845554.317572:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845554.317669:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180203776 00000100:00100000:2.0:1788845554.317680:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180203776 00000100:00100000:2.0:1788845554.317744:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:2.0:1788845554.317755:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+19:14491:x1875740180203776:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:2.0:1788845554.317781:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845554.317802:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfad0d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775280f expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.317901:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.317914:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.317924:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845554.317935:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788845554.318079:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8800/0xd8041b54d6dfad0d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775280f expref: 22 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.318096:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775280f expref: 21 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.318119:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:2.0:1788845554.318121:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845554.318124:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb9200, rc 0) 00000100:00100000:2.0:1788845554.318197:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+21:14491:x1875740180203776:12345-192.168.206.35@tcp:101:cat.0 Request processed in 444us (637us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788845554.318204:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:3.0:1788845554.322487:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845554.322607:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180204032 00000100:00100000:0.0:1788845554.322617:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180204032 00000100:00100000:0.0:1788845554.322677:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:0.0:1788845554.322687:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+21:14491:x1875740180204032:12345-192.168.206.35@tcp:35:cat.0 00000100:00100000:0.0:1788845554.323505:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+22:14491:x1875740180204032:12345-192.168.206.35@tcp:35:cat.0 Request processed in 810us (1021us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788845554.323514:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:3.0:1788845554.324304:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845554.324947:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180204160 00000100:00100000:2.0:1788845554.324956:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180204160 00000100:00100000:2.0:1788845554.325026:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:2.0:1788845554.325036:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+22:2373:x1875740180204160:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845554.325051:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845554.325074:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad14 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775280f expref: 22 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.325093:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:2.0:1788845554.325098:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845554.325503:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+21:2373:x1875740180204160:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 467us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845554.325511:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:3.0:1788845554.380485:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845554.380564:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180204416 00000100:00100000:0.0:1788845554.380574:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180204416 00000100:00100000:0.0:1788845554.380645:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:0.0:1788845554.380656:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+21:14497:x1875740180204416:12345-192.168.206.35@tcp:101:dd.0 00010000:00010000:0.0:1788845554.380679:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845554.380710:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad22 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752816 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.380832:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfad29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.380848:0:14375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfacc7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527f3 expref: 22 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.380858:0:14375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce120077527fa expref: 22 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.380866:0:14375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfad29 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.380903:0:14375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527fa expref: 22 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.380918:0:14375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527fa expref: 22 pid: 16251 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845554.380934:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14375:1875740189619840:192.168.206.35@tcp:104: 00010000:00010000:0.0:1788845554.381071:0:14375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfacc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527f3 expref: 22 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.381101:0:14375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfacc7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527f3 expref: 22 pid: 14374 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845554.381112:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14375:1875740189619968:192.168.206.35@tcp:104: 00000100:00100000:0.0:1788845554.381140:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845554.385879:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845554.386014:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14375:1875740189619840:192.168.206.35@tcp:104: 00000100:00100000:2.0:1788845554.386042:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc84380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14375:1875740189619968:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845554.386093:0:16489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180204544 00000100:00100000:1.0:1788845554.386101:0:16489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180204544 00010000:00010000:1.0:1788845554.386142:0:16489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527fa expref: 23 pid: 16251 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.386143:0:14375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfad29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845554.386200:0:16489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1788845554.386210:0:16489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeb3e52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+23:2374:x1875740180204544:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845554.386224:0:16489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845554.386231:0:16489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527fa expref: 23 pid: 16251 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.386244:0:16489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527fa expref: 23 pid: 16251 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.386265:0:16489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfacdc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527fa expref: 23 pid: 16251 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.386283:0:16489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:1.0:1788845554.386287:0:16489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfad29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.386295:0:16489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfad29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.386301:0:16489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845554.386422:0:16489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeb3e52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+22:2374:x1875740180204544:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 154us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845554.386438:0:16489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:0.0:1788845554.390259:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845554.390423:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180204672 00000100:00100000:3.0:1788845554.390434:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180204672 00010000:00010000:3.0:1788845554.390478:0:14358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfacc7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527f3 expref: 22 pid: 14374 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845554.390520:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:3.0:1788845554.390531:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+22:2372:x1875740180204672:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845554.390546:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845554.390552:0:14358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfacc7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527f3 expref: 22 pid: 14374 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845554.390565:0:14358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfacc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527f3 expref: 22 pid: 14374 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845554.390587:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae8fc08e00/0xd8041b54d6dfacc7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0x461ce120077527f3 expref: 22 pid: 14374 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845554.390607:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:3.0:1788845554.390612:0:14358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfad29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845554.390622:0:14358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfad29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845554.390629:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfad29 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845554.390693:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845554.391074:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+21:2372:x1875740180204672:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 544us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845554.391082:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00010000:00010000:0.0:1788845554.391287:0:14375:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfad29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.391298:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfad29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845554.391319:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788845554.391621:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad22 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752816 expref: 22 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.391640:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030200/0xd8041b54d6dfad29 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752816 expref: 21 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.391649:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:0.0:1788845554.391652:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788845554.391655:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030200, rc 0) 00000100:00100000:0.0:1788845554.391687:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+21:14497:x1875740180204416:12345-192.168.206.35@tcp:101:dd.0 Request processed in 11033us (11215us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788845554.391695:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:0.0:1788845554.394523:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845554.394613:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180204928 00000100:00100000:2.0:1788845554.394624:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180204928 00000100:00100000:2.0:1788845554.394687:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:2.0:1788845554.394698:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+21:14497:x1875740180204928:12345-192.168.206.35@tcp:36:dd.0 00010000:00010000:2.0:1788845554.394967:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad37 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.394984:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.394994:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845554.395069:0:14373:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788845554.395107:0:14373:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000468a85d5 reply state 00000000fad6d158 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845554.395117:0:14373:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845554.395207:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+24:14497:x1875740180204928:12345-192.168.206.35@tcp:36:dd.0 Request processed in 511us (697us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788845554.395215:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 35 00000020:00080000:2.0:1788845554.395219:0:14373:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788845554.397680:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.397700:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad37 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.397708:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.397732:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeaeeb9200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845554.397737:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.397747:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad37 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.397764:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:2.0:1788845554.397767:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845554.397772:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad37 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.397779:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad37 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845554.398046:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845554.398121:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180205056 00000100:00100000:1.0:1788845554.398130:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180205056 00000100:00100000:1.0:1788845554.398185:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:1.0:1788845554.398196:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+23:14497:x1875740180205056:12345-192.168.206.35@tcp:101:dd.0 00010000:00010000:1.0:1788845554.398217:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845554.398234:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfad3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775281d expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.398289:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfad3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775281d expref: 24 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.398304:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfad3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775281d expref: 24 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.398335:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:1.0:1788845554.398338:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845554.398341:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a52200, rc 0) 00000100:00100000:1.0:1788845554.398436:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+24:14497:x1875740180205056:12345-192.168.206.35@tcp:101:dd.0 Request processed in 242us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845554.398443:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:1.0:1788845554.413555:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845554.413699:0:16489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180205312 00000100:00100000:2.0:1788845554.413710:0:16489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180205312 00000100:00100000:2.0:1788845554.413815:0:16489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:2.0:1788845554.413834:0:16489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+24:14497:x1875740180205312:12345-192.168.206.35@tcp:103:dd.0 00010000:00010000:2.0:1788845554.413852:0:16489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845554.413874:0:16489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52200/0xd8041b54d6dfad3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775281d expref: 24 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.413896:0:16489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:2.0:1788845554.413900:0:16489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845554.413958:0:16489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+23:14497:x1875740180205312:12345-192.168.206.35@tcp:103:dd.0 Request processed in 134us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845554.413966:0:16489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:3.0:1788845554.416352:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845554.416451:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180205440 00000100:00100000:2.0:1788845554.416462:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180205440 00000100:00100000:2.0:1788845554.416523:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:2.0:1788845554.416532:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+23:14497:x1875740180205440:12345-192.168.206.35@tcp:58:dd.0 00010000:00010000:2.0:1788845554.416639:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.416656:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.416668:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788845554.417722:0:14373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845554.417882:0:14373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788845554.417957:0:14373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788845554.418342:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+23:14497:x1875740180205440:12345-192.168.206.35@tcp:58:dd.0 Request processed in 1806us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845554.418352:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:0.0:1788845554.424238:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845554.424353:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180205568 00000100:00100000:1.0:1788845554.424525:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180205568 00000100:00100000:1.0:1788845554.424631:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:1.0:1788845554.424642:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+23:14497:x1875740180205568:12345-192.168.206.35@tcp:101:dd.0 00010000:00010000:1.0:1788845554.424697:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845554.424722:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6dfad4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752824 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.424794:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.424813:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6dfad4c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752824 expref: 24 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.424852:0:14374:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.424872:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6dfad4c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752824 expref: 24 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.424885:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:1.0:1788845554.424888:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845554.424892:0:14374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6dfad4c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752824 expref: 24 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845554.424899:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a52a00, rc 0) 00000100:00100000:1.0:1788845554.424964:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+24:14497:x1875740180205568:12345-192.168.206.35@tcp:101:dd.0 Request processed in 318us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845554.424970:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00010000:00010000:3.0:1788845554.717844:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788845554.971946:0:14407:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788845554.971958:0:14407:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845554.971996:0:14407:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788845554.972003:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788845554.972147:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14407:1875740189620096:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788845554.972257:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ae8fdd8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845554.975033:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadc85500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14407:1875740189620096:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788845554.980556:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845554.981310:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180205696 00000100:00100000:1.0:1788845554.981322:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180205696 00000100:00100000:1.0:1788845554.982195:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:1.0:1788845554.982315:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+24:14498:x1875740180205696:12345-192.168.206.35@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788845554.982448:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+24:14498:x1875740180205696:12345-192.168.206.35@tcp:900:lhsmtool_posix.0 Request processed in 143us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845554.982455:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:3.0:1788845554.983927:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845554.984353:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180205824 00000100:00100000:2.0:1788845554.984404:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180205824 00000100:00100000:2.0:1788845554.984468:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:2.0:1788845554.984477:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+24:14498:x1875740180205824:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788845554.984511:0:16251:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788845554.984623:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+24:14498:x1875740180205824:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 147us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845554.984631:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:2.0:1788845554.991453:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845554.991714:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180205952 00000100:00100000:0.0:1788845554.991725:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180205952 00000100:00100000:0.0:1788845554.991799:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:0.0:1788845554.991811:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+24:14498:x1875740180205952:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788845554.991880:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfad53 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.991898:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfad53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.991911:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfad53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.991929:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad5a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.991937:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.991945:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.991996:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfad61 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992006:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfad61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992014:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfad61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845554.992053:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788845554.992057:0:14375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845554.992070:0:14375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfad61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992081:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfad53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992092:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfad53 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992099:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfad53 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992106:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845554.992110:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfad53 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992118:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfad53 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992130:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:0.0:1788845554.992149:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845554.992154:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfad53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992161:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030e00/0xd8041b54d6dfad53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992177:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992184:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad5a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992190:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad5a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992195:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845554.992198:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad5a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992205:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad5a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992213:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff92ae83de9500) 00010000:00010000:0.0:1788845554.992225:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845554.992229:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad5a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992235:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfad5a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992252:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfad61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992264:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfad61 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992270:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfad61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992276:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:0.0:1788845554.992279:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfad61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992285:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfad61 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992293:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:0.0:1788845554.992296:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845554.992298:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfad61 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845554.992304:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80030600/0xd8041b54d6dfad61 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845554.992460:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+24:14498:x1875740180205952:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 Request processed in 650us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845554.992669:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:3.0:1788845554.995596:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845554.995662:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180206208 00000100:00100000:2.0:1788845554.995688:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180206208 00000100:00100000:2.0:1788845554.995792:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:2.0:1788845554.995908:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+24:14498:x1875740180206208:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845554.995929:0:16251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845554.995948:0:16251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfad68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775282b expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996568:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996584:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996596:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845554.996607:0:16251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788845554.996715:0:16251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996723:0:16251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad6f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996728:0:16251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996734:0:16251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeaeeb9e00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845554.996738:0:16251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996745:0:16251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad6f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996768:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:2.0:1788845554.996771:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788845554.996775:0:16251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad6f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996781:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996843:0:16251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfad68 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775282b expref: 26 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996863:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ae83de9a00) 00010000:00010000:2.0:1788845554.996866:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845554.996870:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfad68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775282b expref: 26 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845554.996879:0:16251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb8000, rc 0) 00000100:00100000:2.0:1788845554.996940:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+25:14498:x1875740180206208:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 1139us (1355us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788845554.996948:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:1.0:1788845555.003620:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.003897:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180206336 00000100:00100000:0.0:1788845555.003907:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180206336 00000100:00100000:0.0:1788845555.003994:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:0.0:1788845555.004007:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+25:14498:x1875740180206336:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788845555.004039:0:14374:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788845555.004185:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+25:14498:x1875740180206336:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 181us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845555.004194:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00080000:2.0:1788845555.004776:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845555.008153:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845555.008275:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180206592 00000100:00100000:2.0:1788845555.008286:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180206592 00000100:00100000:2.0:1788845555.008429:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:2.0:1788845555.008440:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+25:14498:x1875740180206592:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845555.008461:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845555.008481:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfad7d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752832 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788845555.009198:0:14373:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1788845555.009205:0:14373:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788845555.009265:0:14373:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788845555.009612:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.009628:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.009640:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.009702:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb8000/0xd8041b54d6dfad7d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752832 expref: 28 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.009720:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752832 expref: 27 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.009729:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ae82b8f400) 00010000:00010000:2.0:1788845555.009732:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845555.009735:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb9e00, rc 0) 00000100:00100000:2.0:1788845555.009807:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+27:14498:x1875740180206592:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 1369us (1667us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788845555.009815:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:0.0:1788845555.022150:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845555.022453:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180206848 00000100:00100000:1.0:1788845555.022464:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180206848 00000100:00100000:1.0:1788845555.022578:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:1.0:1788845555.022591:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadc85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+27:14498:x1875740180206848:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788845555.022660:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845555.022685:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9e00/0xd8041b54d6dfad84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752832 expref: 27 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022705:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ae82b8f400) 00010000:00010000:1.0:1788845555.022715:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845555.022735:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfad92 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022749:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfad92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022758:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfad92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022772:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfad99 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3ec5b6de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022779:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfad99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3ec5b6de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022802:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfad99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3ec5b6de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022887:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfad92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022895:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfad92 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022901:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfad92 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022907:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845555.022911:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfad92 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022917:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfad92 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022925:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ae83de9400) 00010000:00010000:1.0:1788845555.022928:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845555.022930:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfad92 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022936:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfad92 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022945:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfad99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3ec5b6de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022951:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfad99 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3ec5b6de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022963:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfad99 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3ec5b6de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022968:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a53800 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:1.0:1788845555.022971:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfad99 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3ec5b6de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022977:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfad99 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3ec5b6de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022985:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3ec5b6de (ffff92ae93b8e400) 00010000:00010000:1.0:1788845555.022988:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845555.022991:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfad99 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3ec5b6de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.022996:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfad99 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3ec5b6de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845555.023085:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadc85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+26:14498:x1875740180206848:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 497us (947us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788845555.023092:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:3.0:1788845555.027131:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845555.027266:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180206976 00000100:00100000:2.0:1788845555.027277:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180206976 00000100:00100000:2.0:1788845555.027340:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:2.0:1788845555.027351:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+26:14498:x1875740180206976:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845555.027421:0:16251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845555.027444:0:16251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfada0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752839 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.027480:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9400/0xd8041b54d6dfada7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.027494:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9400/0xd8041b54d6dfada7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.027649:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9400/0xd8041b54d6dfada7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.027840:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfada0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752839 expref: 28 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.028042:0:16251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9400/0xd8041b54d6dfada7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752839 expref: 27 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.028052:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ae82b8ff00) 00010000:00010000:2.0:1788845555.028158:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845555.028162:0:16251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92aeaeeb9400, rc 0) 00000100:00100000:2.0:1788845555.028296:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+27:14498:x1875740180206976:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 946us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845555.028304:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:2.0:1788845555.031074:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.031327:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180207232 00000100:00100000:0.0:1788845555.031336:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180207232 00000100:00100000:0.0:1788845555.031453:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:0.0:1788845555.031464:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+27:14498:x1875740180207232:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788845555.031644:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfadae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.031661:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfadae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.031672:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfadae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788845555.032656:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788845555.032671:0:14374:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364252308228ns, next at 365252305133ns, rc = 0 00000004:00010000:0.0:1788845555.032847:0:14374:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017c941fc reply state 00000000664b9e73 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfadae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845555.032859:0:14374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845555.033041:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+29:14498:x1875740180207232:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 1577us (1975us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788845555.033049:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 46 00010000:00010000:2.0:1788845555.040902:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfadae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.040960:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfadae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.040968:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfadae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.040974:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845555.040978:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfadae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.040985:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfadae lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.041001:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ae82b8ff00) 00010000:00010000:2.0:1788845555.041003:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788845555.041008:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfadae lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.041015:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031c00/0xd8041b54d6dfadae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845555.042652:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845555.042766:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180207360 00000100:00100000:1.0:1788845555.042776:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180207360 00000100:00100000:1.0:1788845555.043049:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:1.0:1788845555.043061:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ad82f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+28:14498:x1875740180207360:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845555.043084:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845555.043102:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfadb5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752840 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.043190:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfadb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752840 expref: 29 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.043204:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfadb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752840 expref: 29 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.043221:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ae82b8ff00) 00010000:00010000:1.0:1788845555.043224:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845555.043228:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a53800, rc 0) 00000100:00100000:1.0:1788845555.043290:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ad82f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+29:14498:x1875740180207360:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 232us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845555.043297:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:0.0:1788845555.045629:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845555.045709:0:15883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180207488 00000100:00100000:2.0:1788845555.045718:0:15883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180207488 00000100:00100000:2.0:1788845555.045788:0:15883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:2.0:1788845555.045798:0:15883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc76d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+5:2372:x1875740180207488:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788845555.046149:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845555.046526:0:15883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc76d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:2372:x1875740180207488:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 727us (904us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788845555.046535:0:15883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:3.0:1788845555.051256:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845555.051489:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180207744 00000100:00100000:1.0:1788845555.051499:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180207744 00000100:00100000:1.0:1788845555.051547:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:1.0:1788845555.051556:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+29:14498:x1875740180207744:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788845555.052009:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+30:14498:x1875740180207744:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 452us (762us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788845555.052017:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:1.0:1788845555.055983:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845555.056046:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180208000 00000100:00100000:3.0:1788845555.056057:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180208000 00000100:00100000:3.0:1788845555.056165:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:3.0:1788845555.056185:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+30:14498:x1875740180208000:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788845555.056303:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+30:14498:x1875740180208000:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 128us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845555.056310:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:2.0:1788845555.058575:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845555.058703:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180208128 00000100:00100000:1.0:1788845555.058712:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180208128 00000100:00100000:1.0:1788845555.058807:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:1.0:1788845555.058816:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+30:14498:x1875740180208128:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845555.058833:0:16251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845555.058866:0:16251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6dfadbc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce12007752847 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.058935:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfadc3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.058948:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfadc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.058959:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfadc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845555.058997:0:16251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845555.059015:0:16251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfadc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.059038:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52400/0xd8041b54d6dfadbc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752847 expref: 32 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.059054:0:16251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfadc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752847 expref: 31 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.059073:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ae82b8ff00) 00010000:00010000:1.0:1788845555.059076:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788845555.059078:0:16251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae89a52600, rc 0) 00000100:00100000:1.0:1788845555.059135:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+31:14498:x1875740180208128:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 321us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845555.059143:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:3.0:1788845555.061545:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.061650:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180208256 00000100:00100000:0.0:1788845555.061673:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180208256 00000100:00100000:0.0:1788845555.061767:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:0.0:1788845555.061778:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+6:2373:x1875740180208256:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845555.061795:0:15054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845555.061827:0:15054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfadca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x461ce1200775284e expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788845555.061855:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9df2, blocks: 0x1 00010000:00010000:0.0:1788845555.061874:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1788845555.061879:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845555.061889:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfadca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775284e expref: 7 pid: 15054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.061907:0:15054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfadca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775284e expref: 7 pid: 15054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.061919:0:15054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ae80030e00, rc 0) 00000100:00100000:0.0:1788845555.061978:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:2373:x1875740180208256:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 203us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845555.061985:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:2.0:1788845555.064086:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845555.064188:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180208512 00000100:00100000:1.0:1788845555.064197:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180208512 00000100:00100000:1.0:1788845555.064269:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:1.0:1788845555.064279:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+31:14498:x1875740180208512:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788845555.064408:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+31:14498:x1875740180208512:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 117us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845555.064418:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:2.0:1788845555.066321:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.066458:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180208640 00000100:00100000:0.0:1788845555.066466:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180208640 00000100:00100000:0.0:1788845555.066571:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:0.0:1788845555.066582:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+31:14498:x1875740180208640:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788845555.112879:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+31:14498:x1875740180208640:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 Request processed in 46268us (46536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845555.112893:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 51 00000001:00080000:1.0:1788845555.113554:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1788845555.113563:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788845555.113789:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000001:00080000:1.0:1788845555.113963:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1788845555.113979:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:0.0:1788845555.114096:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189620224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788845555.114179:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845555.114560:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189620224 00000100:00100000:3.0:1788845555.114568:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189620224 00000100:00100000:1.0:1788845555.114884:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.115203:0:15883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180208768 00000100:00100000:0.0:1788845555.115208:0:15883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180208768 00000100:00100000:0.0:1788845555.115303:0:15883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:0.0:1788845555.115314:0:15883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:2372:x1875740180208768:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788845555.115458:0:15883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:2372:x1875740180208768:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 Request processed in 145us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845555.115465:0:15883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:3.0:1788845555.116124:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788845555.116135:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189620224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788845555.116479:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788845555.116497:0:15056:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788845555.116500:0:15056:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788845555.116502:0:15056:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788845554 -> 1788845554 00002000:00010000:3.0:1788845555.116505:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788845555.116569:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1875740189620224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 436us (2389us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788845555.116577:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1788845555.116689:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92aeae224380/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788845555.116697:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189620224:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788845555.116813:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845555.117516:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.117631:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180209024 00000100:00100000:0.0:1788845555.117638:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180209024 00000100:00100000:0.0:1788845555.117722:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:0.0:1788845555.117732:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+14:14498:x1875740180209024:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788845555.117785:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845555.117810:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52600/0xd8041b54d6dfadc3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752847 expref: 14 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.117829:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ae82b8ff00) 00010000:00010000:0.0:1788845555.117833:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845555.117870:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfadd1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.117883:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfadd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.117891:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfadd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845555.118228:0:14373:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007de5fdc2 reply state 00000000a2524219 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfadd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845555.118240:0:14373:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845555.118470:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+15:14498:x1875740180209024:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 738us (956us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788845555.118478:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 52 00010000:00010000:2.0:1788845555.121921:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfadd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.121943:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfadd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845555.121951:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:2.0:1788845555.121956:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfadd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.121964:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845555.121970:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfadd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.121979:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfadd1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.121996:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ae82b8ff00) 00010000:00010000:2.0:1788845555.121999:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845555.122004:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfadd1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.122011:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae80031200/0xd8041b54d6dfadd1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845555.122108:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180209152 00000100:00100000:3.0:1788845555.122119:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180209152 00000100:00100000:3.0:1788845555.122186:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:3.0:1788845555.122197:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+7:2373:x1875740180209152:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788845555.122467:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788845555.122472:0:15056:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788845553 00002000:00010000:3.0:1788845555.122475:0:15056:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788845553 00002000:00010000:3.0:1788845555.122478:0:15056:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788845554 -> 1788845553 00002000:00010000:3.0:1788845555.122481:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788845555.122548:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+8:2373:x1875740180209152:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 352us (604us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788845555.122557:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:3.0:1788845555.128734:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845555.128842:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180209280 00000100:00100000:2.0:1788845555.128872:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180209280 00000100:00100000:2.0:1788845555.128930:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:2.0:1788845555.128940:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+8:2372:x1875740180209280:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788845555.128996:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b7ea2f9b/0xd8041b54d6dfadd8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.129014:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845555.129018:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845555.129023:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7ea2f9b/0xd8041b54d6dfadd8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.129037:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7ea2f9b/0xd8041b54d6dfadd8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.129080:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b7ea2f9b/0xd8041b54d6dfadd8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.129089:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7ea2f9b/0xd8041b54d6dfadd8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.129097:0:15055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7ea2f9b/0xd8041b54d6dfadd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.129104:0:15055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeaeeb9600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845555.129108:0:15055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7ea2f9b/0xd8041b54d6dfadd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.129128:0:15055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7ea2f9b/0xd8041b54d6dfadd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.129143:0:15055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7ea2f9b/0xd8041b54d6dfadd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.129151:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7ea2f9b/0xd8041b54d6dfadd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845555.129431:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+8:2372:x1875740180209280:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 Request processed in 491us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845555.129439:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:2.0:1788845555.133112:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845555.133241:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180209536 00000100:00100000:1.0:1788845555.133251:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180209536 00000100:00100000:1.0:1788845555.133312:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:1.0:1788845555.133324:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+14:14498:x1875740180209536:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788845555.133440:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6dfaddf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.133458:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6dfaddf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.133470:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6dfaddf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.133773:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.133795:0:16251:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfadb5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752840 expref: 15 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.133816:0:16251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.133852:0:16251:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfadb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752840 expref: 15 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.133867:0:16251:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfadb5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752840 expref: 15 pid: 14375 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845555.133880:0:16251:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16251:1875740189620352:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845555.133966:0:16251:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb7b3f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845555.139477:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.139924:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180209664 00000100:00100000:0.0:1788845555.139935:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180209664 00010000:00010000:0.0:1788845555.139980:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfadb5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752840 expref: 16 pid: 14375 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845555.140026:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:0.0:1788845555.140037:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+16:2373:x1875740180209664:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845555.140052:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845555.140059:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfadb5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752840 expref: 16 pid: 14375 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.140073:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfadb5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752840 expref: 16 pid: 14375 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.140097:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ae82b8ff00) 00010000:00010000:0.0:1788845555.140103:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.140112:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.140141:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.140160:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845555.140223:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+16:2373:x1875740180209664:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 187us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845555.140231:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00010000:00010000:2.0:1788845555.140622:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53800/0xd8041b54d6dfadb5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce12007752840 expref: 15 pid: 14375 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845555.140641:0:16251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16251:1875740189620352:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845555.140664:0:16251:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.140673:0:16251:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.140679:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845555.141474:0:16251:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788845555.141648:0:16251:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788845555.141701:0:16251:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788845555.142202:0:16251:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae227100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16251:1875740189620480:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788845555.142570:0:16251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845555.142610:0:16251:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeae2103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845555.143940:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189620480 00000100:00100000:1.0:1788845555.143954:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189620480 00000100:00100000:1.0:1788845555.144016:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845555.144026:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16251:x1875740189620480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788845555.144129:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16251:x1875740189620480:12345-0@lo:1000:mdt00_003.0 Request processed in 105us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845555.144137:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845555.145448:0:16251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae227100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16251:1875740189620480:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788845555.146155:0:16251:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788845555.146257:0:16251:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeae227100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16251:1875740189620608:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788845555.146316:0:16251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845555.146351:0:16251:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeae210a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788845555.146746:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189620608 00000100:00100000:1.0:1788845555.146753:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189620608 00000100:00100000:1.0:1788845555.146802:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845555.146810:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16251:x1875740189620608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788845555.146988:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16251:x1875740189620608:12345-0@lo:1000:mdt00_003.0 Request processed in 178us (671us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788845555.147004:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845555.147096:0:16251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeae227100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16251:1875740189620608:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788845555.147130:0:16251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147140:0:16251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147154:0:16251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147161:0:16251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a53c00 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845555.147166:0:16251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147174:0:16251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147188:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ae82b8ff00) 00010000:00010000:3.0:1788845555.147192:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845555.147196:0:16251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147202:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53c00/0xd8041b54d6dfade6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147236:0:16251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147243:0:16251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147249:0:16251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147254:0:16251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeaeeb9200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:3.0:1788845555.147257:0:16251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147273:0:16251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147282:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:3.0:1788845555.147284:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845555.147292:0:16251:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6dfad4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752824 expref: 18 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147302:0:16251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6dfad4c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752824 expref: 18 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147311:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6dfad4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752824 expref: 18 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.147336:0:16251:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a52a00/0xd8041b54d6dfad4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce12007752824 expref: 18 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845555.147347:0:16251:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc847800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16251:1875740189620736:192.168.206.35@tcp:105: 00000100:00100000:3.0:1788845555.147458:0:16251:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb3c99840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845555.151768:0:16251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc847800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16251:1875740189620736:192.168.206.35@tcp:105: 00010000:00010000:2.0:1788845555.151802:0:16251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151813:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9200/0xd8041b54d6dfad45 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151851:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfaded lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151864:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfaded lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151875:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfaded lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151885:0:16251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfaded lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151905:0:16251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfaded lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151912:0:16251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfaded lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151917:0:16251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeaeeb9600 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845555.151921:0:16251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfaded lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151928:0:16251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfaded lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151940:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:2.0:1788845555.151943:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845555.151946:0:16251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfaded lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151951:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeaeeb9600/0xd8041b54d6dfaded lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151961:0:16251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6dfaddf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151966:0:16251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6dfaddf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151972:0:16251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6dfaddf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151977:0:16251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a53200 already unused, calling callback (ffffffffc201d4f0) 00010000:00010000:2.0:1788845555.151986:0:16251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6dfaddf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.151992:0:16251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6dfaddf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.152000:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ae93b8e800) 00010000:00010000:2.0:1788845555.152002:0:16251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845555.152005:0:16251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6dfaddf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.152010:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ae89a53200/0xd8041b54d6dfaddf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845555.152425:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845555.152754:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+18:14498:x1875740180209536:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 19431us (19651us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788845555.152764:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 53 00000020:00080000:2.0:1788845555.152769:0:16251:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788845555.153047:0:14407:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788845555.153051:0:14407:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788845555.153085:0:14407:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788845555.153090:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788845555.156563:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180209792 00000100:00100000:0.0:1788845555.156579:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180209792 00000100:00100000:0.0:1788845555.156687:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:0.0:1788845555.156698:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ae8fdf8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+18:14497:x1875740180209792:12345-192.168.206.35@tcp:49:dd.0 00000100:00100000:0.0:1788845555.156849:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ae8fdf8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+18:14497:x1875740180209792:12345-192.168.206.35@tcp:49:dd.0 Request processed in 152us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845555.156857:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:1.0:1788845555.159272:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845555.162191:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180210048 00000100:00100000:2.0:1788845555.162206:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180210048 00000100:00100000:3.0:1788845555.162664:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:3.0:1788845555.162676:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+18:14498:x1875740180210048:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788845555.163481:0:14376:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788845555.163597:0:14376:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788845555.163641:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb422be00/0xd8041b54d6dfadf4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.163657:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb422be00/0xd8041b54d6dfadf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.163669:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb422be00/0xd8041b54d6dfadf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.163678:0:14376:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb422be00/0xd8041b54d6dfadf4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.163686:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb422be00/0xd8041b54d6dfadf4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.163692:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb422be00/0xd8041b54d6dfadf4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.163714:0:14376:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788845555.163818:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3582157f-7d60-4d28-a42b-ea8dc01a2de4+20:14498:x1875740180210048:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 1141us (4554us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788845555.163827:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000020:00080000:3.0:1788845555.163832:0:14376:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788845555.164249:0:15886:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845555.164257:0:15886:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb422be00/0xd8041b54d6dfadf4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.164266:0:15886:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422be00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845555.164270:0:15886:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb422be00/0xd8041b54d6dfadf4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.164279:0:15886:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb422be00/0xd8041b54d6dfadf4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.164292:0:15886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ae82b8ff00) 00010000:00010000:2.0:1788845555.164306:0:15886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788845555.164311:0:15886:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb422be00/0xd8041b54d6dfadf4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.164317:0:15886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92aeb422be00/0xd8041b54d6dfadf4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.164332:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845555.164333:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845555.164335:0:15886:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845555.341545:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1788845555.341584:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845555.341793:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180210304 00000100:00100000:1.0:1788845555.341802:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180210304 00000100:00100000:1.0:1788845555.341872:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180210176 00000100:00100000:1.0:1788845555.341876:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180210176 00000100:00100000:1.0:1788845555.341894:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:1.0:1788845555.341902:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+9:2374:x1875740180210304:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:1.0:1788845555.341935:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.341955:0:15061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfadca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0x461ce1200775284e expref: 9 pid: 15054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.341964:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845555.341968:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845555.341973:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.342005:0:15061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfadca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775284e expref: 9 pid: 15054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.342017:0:15061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfadca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775284e expref: 9 pid: 15054 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845555.342043:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aeadd13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:15061:1875740189620864:192.168.206.35@tcp:104: 00000100:00100000:1.0:1788845555.342147:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff92aeb7b3f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788845555.346469:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845555.347072:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aeadd13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:15061:1875740189620864:192.168.206.35@tcp:104: 00010000:00010000:2.0:1788845555.347102:0:15061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845555.347337:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788845555.347347:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788845555.348193:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180210432 00000100:00100000:3.0:1788845555.348202:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180210432 00000100:00100000:1.0:1788845555.349154:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:1.0:1788845555.349169:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+10:2374:x1875740180210176:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:1.0:1788845555.349201:0:16604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.349219:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845555.349223:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845555.349228:0:16604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.349238:0:16604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845555.352278:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845555.352510:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845555.352540:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1788845555.352569:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.352824:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788845555.352835:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788845555.353005:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788845555.353021:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180210560 00000100:00100000:1.0:1788845555.353029:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180210560 00000100:00100000:2.0:1788845555.353194:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180210944 00000100:00100000:2.0:1788845555.353199:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180210944 00000100:00100000:2.0:1788845555.353238:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788845555.353243:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180211072 00000100:00100000:2.0:1788845555.353246:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180211072 00000100:00100000:0.0:1788845555.353932:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:0.0:1788845555.353946:0:16605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeadd11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3582157f-7d60-4d28-a42b-ea8dc01a2de4+13:2375:x1875740180210432:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:0.0:1788845555.353981:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.354001:0:16605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845555.354007:0:16605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845555.354011:0:16605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.354033:0:16605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845555.354922:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180210688 00000100:00100000:3.0:1788845555.354932:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180210688 00010000:00010000:3.0:1788845555.354979:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfadca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775284e expref: 14 pid: 15054 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845555.355030:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:3.0:1788845555.355039:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+14:2373:x1875740180210688:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845555.355050:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845555.355087:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfadca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775284e expref: 14 pid: 15054 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.355101:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfadca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775284e expref: 14 pid: 15054 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.355123:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019fd82dd/0xd8041b54d6dfadca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0x461ce1200775284e expref: 14 pid: 15054 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.355137:0:14359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845555.355141:0:14359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845555.355146:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.355156:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.355164:0:14359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845555.355166:0:14359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845555.355170:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.355184:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.355191:0:14359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845555.355194:0:14359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845555.355197:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.355204:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.355245:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845555.355336:0:16605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.355346:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.355420:0:15061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.355429:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.357081:0:16604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.357101:0:16604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845555.357109:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+14:2373:x1875740180210688:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 2064us (4836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845555.357124:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:0.0:1788845555.357453:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.357545:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.357967:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788845555.357977:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1788845555.358252:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180211200 00000100:00100000:0.0:1788845555.358261:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180211200 00000100:00100000:0.0:1788845555.358304:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788845555.358310:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180210816 00000100:00100000:0.0:1788845555.358313:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180210816 00000100:00100000:0.0:1788845555.363381:0:16606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:0.0:1788845555.363411:0:16606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3582157f-7d60-4d28-a42b-ea8dc01a2de4+16:2375:x1875740180210944:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:0.0:1788845555.363456:0:16606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061e6dec/0xd8041b54d6dfae10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.363476:0:16606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845555.363480:0:16606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845555.363487:0:16606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000061e6dec/0xd8041b54d6dfae10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.363501:0:16606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000061e6dec/0xd8041b54d6dfae10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845555.420402:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.421198:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.421248:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.421276:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1788845555.421309:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1788845555.421338:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180211456 00000100:00100000:1.0:1788845555.421350:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180211456 00000100:00100000:1.0:1788845555.421442:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180211712 00000100:00100000:1.0:1788845555.421447:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180211712 00000100:00100000:1.0:1788845555.421463:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180211840 00000100:00100000:1.0:1788845555.421465:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180211840 00000100:00100000:1.0:1788845555.421483:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1788845555.421492:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+5:2372:x1875740180211456:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1788845555.421973:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:2.0:1788845555.421989:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+5:2372:x1875740180211712:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845555.422067:0:15883:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788845555.422075:0:15883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788845555.422093:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180211328 00000100:00100000:0.0:1788845555.422097:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180211328 00000100:00100000:0.0:1788845555.422128:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 119 00000100:00100000:0.0:1788845555.422136:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:2372:x1875740180211328:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845555.422215:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3582157f-7d60-4d28-a42b-ea8dc01a2de4+5:2372:x1875740180211456:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 722us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845555.422223:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1788845555.422467:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1788845555.422476:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11985c56-cf2e-4eab-9399-f2abe779dd74+5:2372:x1875740180211840:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1788845555.422505:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11985c56-cf2e-4eab-9399-f2abe779dd74+5:2372:x1875740180211840:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 31us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845555.422512:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:2.0:1788845555.422575:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+5:2372:x1875740180211712:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 587us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845555.422584:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:0.0:1788845555.422691:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9e76bdf6-a1d0-4c8e-8ae3-5f8a86505d4a+13:2372:x1875740180211328:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 554us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845555.422700:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 119 00000100:00100000:0.0:1788845555.422742:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740180211584 00000100:00100000:0.0:1788845555.422746:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740180211584 00000100:00100000:0.0:1788845555.422783:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:0.0:1788845555.422791:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+6:2372:x1875740180211584:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1788845555.422827:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11985c56-cf2e-4eab-9399-f2abe779dd74+6:2372:x1875740180211584:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 37us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845555.422834:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00080000:0.0:1788845555.422854:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845555.422858:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845555.422860:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788845555.465521:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1788845555.466238:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1788845555.466337:0:15061:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 6291456 00002000:00010000:2.0:1788845555.466341:0:15061:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788845553 -> 1788845554 00002000:00010000:2.0:1788845555.466344:0:15061:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788845553 -> 1788845554 00002000:00010000:2.0:1788845555.466346:0:15061:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1788845555.466377:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.466389:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.466407:0:15061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.466414:0:15061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a53200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845555.466419:0:15061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.466430:0:15061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.466452:0:15061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.466479:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000def3b8fc/0xd8041b54d6dfadfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845555.466922:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+21:2374:x1875740180210304:12345-192.168.206.35@tcp:4:dd.0 Request processed in 125014us (125382us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788845555.466933:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:2.0:1788845555.466963:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:2.0:1788845555.466973:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+20:2375:x1875740180211072:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:2.0:1788845555.467008:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aca91ee/0xd8041b54d6dfae17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.467020:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845555.467024:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845555.467029:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aca91ee/0xd8041b54d6dfae17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.467040:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aca91ee/0xd8041b54d6dfae17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845555.514744:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1788845555.515178:0:16604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1788845555.515185:0:16604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 8199 00010000:00010000:1.0:1788845555.515200:0:16604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.515227:0:16604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.515236:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.515243:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a53a00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845555.515248:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.515257:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.515279:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.515286:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063a97373/0xd8041b54d6dfae02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.515649:0:16606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061e6dec/0xd8041b54d6dfae10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.515659:0:16606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000061e6dec/0xd8041b54d6dfae10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.515667:0:16606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000061e6dec/0xd8041b54d6dfae10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.515673:0:16606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80030600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845555.515677:0:16606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000061e6dec/0xd8041b54d6dfae10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.515693:0:16606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000061e6dec/0xd8041b54d6dfae10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.515706:0:16606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000061e6dec/0xd8041b54d6dfae10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.515714:0:16606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000061e6dec/0xd8041b54d6dfae10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845555.515758:0:16606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3582157f-7d60-4d28-a42b-ea8dc01a2de4+15:2375:x1875740180210944:12345-192.168.206.35@tcp:4:dd.0 Request processed in 152358us (163211us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788845555.515767:0:16606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:3.0:1788845555.515801:0:16606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:3.0:1788845555.515813:0:16606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aeae226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3582157f-7d60-4d28-a42b-ea8dc01a2de4+14:2375:x1875740180210560:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:3.0:1788845555.515844:0:16606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfae1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.515858:0:16606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845555.515862:0:16606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845555.515869:0:16606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfae1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.515881:0:16606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfae1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845555.516043:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+15:2374:x1875740180210176:12345-192.168.206.35@tcp:4:dd.0 Request processed in 166878us (174457us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788845555.516052:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:1.0:1788845555.516139:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:1.0:1788845555.516149:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+14:2375:x1875740180211200:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:1.0:1788845555.516166:0:16604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae768dd/0xd8041b54d6dfae25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.516181:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845555.516184:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845555.516189:0:16604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ae768dd/0xd8041b54d6dfae25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.516198:0:16604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ae768dd/0xd8041b54d6dfae25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.516710:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.516722:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.516740:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.516747:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031c00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:0.0:1788845555.516751:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.516759:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.516772:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.516780:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a565130/0xd8041b54d6dfae09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845555.516825:0:16605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeadd11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3582157f-7d60-4d28-a42b-ea8dc01a2de4+13:2375:x1875740180210432:12345-192.168.206.35@tcp:4:dd.0 Request processed in 162882us (170376us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788845555.516832:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:0.0:1788845555.516851:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:0.0:1788845555.516859:0:16605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3582157f-7d60-4d28-a42b-ea8dc01a2de4+12:2374:x1875740180210816:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:0.0:1788845555.516878:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe2f4a75/0xd8041b54d6dfae2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.516887:0:16605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845555.516895:0:16605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845555.516900:0:16605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2f4a75/0xd8041b54d6dfae2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845555.516909:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe2f4a75/0xd8041b54d6dfae2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845555.562820:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:2.0:1788845555.563574:0:15061:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788845555.563581:0:15061:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:2.0:1788845555.563596:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aca91ee/0xd8041b54d6dfae17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.563696:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007aca91ee/0xd8041b54d6dfae17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.563706:0:15061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007aca91ee/0xd8041b54d6dfae17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.563715:0:15061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeaeeb9e00 already unused, calling callback (ffffffffc1609350) 00010000:00010000:2.0:1788845555.563720:0:15061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007aca91ee/0xd8041b54d6dfae17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.563735:0:15061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007aca91ee/0xd8041b54d6dfae17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.563760:0:15061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007aca91ee/0xd8041b54d6dfae17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845555.563768:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aca91ee/0xd8041b54d6dfae17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845555.563871:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3582157f-7d60-4d28-a42b-ea8dc01a2de4+17:2375:x1875740180211072:12345-192.168.206.35@tcp:4:dd.0 Request processed in 96896us (211296us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788845555.563881:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00002000:00010000:1.0:1788845555.640471:0:16605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:1.0:1788845555.640494:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe2f4a75/0xd8041b54d6dfae2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.640509:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2f4a75/0xd8041b54d6dfae2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.640518:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe2f4a75/0xd8041b54d6dfae2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.640525:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae80031200 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845555.640529:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2f4a75/0xd8041b54d6dfae2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.640538:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2f4a75/0xd8041b54d6dfae2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.640560:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe2f4a75/0xd8041b54d6dfae2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.640588:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe2f4a75/0xd8041b54d6dfae2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845555.640682:0:16605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3582157f-7d60-4d28-a42b-ea8dc01a2de4+15:2374:x1875740180210816:12345-192.168.206.35@tcp:4:dd.0 Request processed in 123820us (283133us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788845555.640693:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00010000:00010000:1.0:1788845555.641256:0:16604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae768dd/0xd8041b54d6dfae25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.641267:0:16604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ae768dd/0xd8041b54d6dfae25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.641275:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ae768dd/0xd8041b54d6dfae25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.641282:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ae89a52600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:1.0:1788845555.641285:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae768dd/0xd8041b54d6dfae25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.641293:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae768dd/0xd8041b54d6dfae25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.641318:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ae768dd/0xd8041b54d6dfae25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845555.641340:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ae768dd/0xd8041b54d6dfae25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845555.641442:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3582157f-7d60-4d28-a42b-ea8dc01a2de4+13:2375:x1875740180211200:12345-192.168.206.35@tcp:4:dd.0 Request processed in 125293us (283988us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788845555.641451:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00010000:00010000:3.0:1788845555.642540:0:16606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfae1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.642555:0:16606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfae1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.642563:0:16606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfae1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.642570:0:16606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92aeb422b600 already unused, calling callback (ffffffffc1609350) 00010000:00010000:3.0:1788845555.642575:0:16606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfae1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.642584:0:16606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfae1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.642599:0:16606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfae1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845555.642607:0:16606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf4be66e/0xd8041b54d6dfae1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845555.642684:0:16606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aeae226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3582157f-7d60-4d28-a42b-ea8dc01a2de4+11:2375:x1875740180210560:12345-192.168.206.35@tcp:4:dd.0 Request processed in 126872us (290172us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788845555.642693:0:16606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000001:00080000:1.0:1788845555.643212:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:1.0:1788845555.643234:0:7612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:2.0:1788845555.742163:0:14362:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845556.763564:0:15885:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845556.827626:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189620992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845556.827708:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845556.828184:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189621504:0@lo:400:kworker.0 00000100:00100000:0.0:1788845556.828229:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845556.828250:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788845556.828256:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d9107f4-aa08-4701-832e-746d9df521c4:3285:1875740189621120:0@lo:400:kworker.0 00000100:00100000:0.0:1788845556.828282:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845556.828304:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189621632:0@lo:400:kworker.0 00000100:00100000:0.0:1788845556.828328:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845556.828393:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189620992 00000100:00100000:0.0:1788845556.828401:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189620992 00000100:00100000:0.0:1788845556.828454:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845556.828463:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189620992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845556.828498:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845556.828673:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189621248:0@lo:400:kworker.0 00000100:00100000:3.0:1788845556.828706:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845556.828728:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845556.828734:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189621376:0@lo:400:kworker.0 00000100:00100000:3.0:1788845556.828757:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845556.828788:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189621248 00000100:00100000:3.0:1788845556.828793:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189621248 00000100:00100000:3.0:1788845556.828824:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788845556.828831:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189621248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845556.828869:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875740189621248:12345-0@lo:400:kworker.0 Request processed in 39us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845556.828877:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788845556.828974:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189621504 00000100:00100000:3.0:1788845556.828979:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189621504 00000100:00100000:3.0:1788845556.829006:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189621632 00000100:00100000:3.0:1788845556.829009:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189621632 00000100:00100000:3.0:1788845556.829021:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189621376 00000100:00100000:3.0:1788845556.829023:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189621376 00000100:00100000:3.0:1788845556.829032:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788845556.829038:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189621504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845556.829085:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875740189621504:12345-0@lo:400:kworker.0 Request processed in 47us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845556.829092:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788845556.829103:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788845556.829109:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189621632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845556.829147:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875740189621632:12345-0@lo:400:kworker.0 Request processed in 38us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845556.829172:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788845556.829185:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788845556.829190:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189621376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845556.829231:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875740189621376:12345-0@lo:400:kworker.0 Request processed in 40us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845556.829237:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788845556.829277:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875740189621376:0@lo:400:kworker.0 00000100:00100000:3.0:1788845556.829287:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788845556.829292:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92aeae224380, transno 8589934595 00000004:00080000:3.0:1788845556.829303:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788845556.829324:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875740189621248:0@lo:400:kworker.0 00000100:00100000:0.0:1788845556.829726:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875740189620992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1262us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845556.829734:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845556.829759:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189621120 00000100:00100000:0.0:1788845556.829770:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189621120 00000100:00100000:0.0:1788845556.829799:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788845556.829805:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebb04c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+19:3285:x1875740189621120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845556.829840:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebb04c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d9107f4-aa08-4701-832e-746d9df521c4+19:3285:x1875740189621120:12345-0@lo:400:kworker.0 Request processed in 35us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845556.829846:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1788845556.829874:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845556.829879:0:14369:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845556.829979:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d9107f4-aa08-4701-832e-746d9df521c4:3285:1875740189621120:0@lo:400:kworker.0 00000100:00100000:0.0:1788845556.829994:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875740189621632:0@lo:400:kworker.0 00000100:00100000:0.0:1788845556.830006:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875740189621504:0@lo:400:kworker.0 00000100:00100000:0.0:1788845556.830021:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875740189620992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845556.832332:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845556.832352:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189621760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845556.832444:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845556.832490:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740189621760 00000100:00100000:0.0:1788845556.832496:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740189621760 00000100:00100000:0.0:1788845556.832968:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788845556.832981:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92aebc8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189621760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845556.833012:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788845556.833296:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92aebc8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875740189621760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 318us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845556.833303:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788845556.833664:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92aebc8e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875740189621760:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788845557.106258:0:16646:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788845557.787533:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28223 lines, 28223 kept, 0 dropped, 0 bad.